Jun 08 18:04:52.326804 ip-10-0-140-216 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 18:04:52.326816 ip-10-0-140-216 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 18:04:52.326823 ip-10-0-140-216 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 18:04:52.327069 ip-10-0-140-216 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 18:05:02.374511 ip-10-0-140-216 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 08 18:05:02.374527 ip-10-0-140-216 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a851bd3c55b94316b8f5395d7a238cd2 -- Jun 08 18:07:22.772667 ip-10-0-140-216 systemd[1]: Starting Kubernetes Kubelet... Jun 08 18:07:23.217485 ip-10-0-140-216 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 18:07:23.217485 ip-10-0-140-216 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 18:07:23.217485 ip-10-0-140-216 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 18:07:23.218595 ip-10-0-140-216 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 18:07:23.218595 ip-10-0-140-216 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 18:07:23.218703 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.218615 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 18:07:23.226080 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226053 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 18:07:23.226080 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226076 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 18:07:23.226080 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226080 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 18:07:23.226080 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226083 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 18:07:23.226080 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226086 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 18:07:23.226080 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226090 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226093 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226096 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226099 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226102 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226105 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226108 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226111 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226113 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226116 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226118 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226121 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226124 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226126 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226129 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226131 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226134 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226137 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226141 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226145 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 18:07:23.226324 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226148 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226151 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226154 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226156 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226166 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226168 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226171 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226174 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226177 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226180 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226182 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226185 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226187 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226190 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226194 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226196 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226199 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226201 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226204 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226207 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 18:07:23.226830 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226209 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226212 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226215 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226218 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226221 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226225 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226228 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226231 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226233 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226236 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226238 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226241 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226244 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226246 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226249 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226251 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226254 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226256 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226259 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226262 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 18:07:23.227342 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226264 2556 feature_gate.go:328] unrecognized feature gate: Example Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226267 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226270 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226273 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226275 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226277 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226280 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226283 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226286 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226289 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226292 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226295 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226297 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226300 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226303 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226305 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226308 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226310 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226314 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 18:07:23.227857 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226317 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226319 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226322 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226324 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226329 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226333 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226336 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226339 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226342 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226344 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226347 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226350 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226354 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226358 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.226361 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227113 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227121 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227126 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 18:07:23.228325 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227130 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227134 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227137 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227141 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227144 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227147 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227150 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227153 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227156 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227159 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227162 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227165 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227167 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227170 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227174 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227177 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227179 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227182 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227185 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227187 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 18:07:23.228785 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227190 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227192 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227195 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227197 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227200 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227203 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227205 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227208 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227210 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227213 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227216 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227219 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227221 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227224 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227227 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227230 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227233 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227235 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227238 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227242 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 18:07:23.229293 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227244 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227247 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227249 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227252 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227254 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227257 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227260 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227264 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227266 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227269 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227271 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227274 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227276 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227279 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227281 2556 feature_gate.go:328] unrecognized feature gate: Example Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227284 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227287 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227289 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227291 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227294 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 18:07:23.229840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227297 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227300 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227303 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227307 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227310 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227315 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227318 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227321 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227324 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227327 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227330 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227333 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227335 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227338 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227340 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227343 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227346 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227348 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227351 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 18:07:23.230337 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227354 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227357 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227360 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227362 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227365 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227367 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227370 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227388 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227392 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227394 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227397 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227400 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227403 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227406 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227409 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227413 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227415 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227819 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227824 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 18:07:23.230817 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227827 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227830 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227834 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227837 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227840 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227843 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227846 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227849 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227853 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227857 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227860 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227863 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227866 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227869 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227872 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227875 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227878 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227881 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227884 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 18:07:23.231299 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227887 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227889 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227892 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227895 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227897 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227900 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227903 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227906 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227908 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227911 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227913 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227916 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227919 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227924 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227927 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227930 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227933 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227936 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227939 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 18:07:23.231805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227942 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227945 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227947 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227950 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227953 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227955 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227958 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227961 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227963 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227966 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227969 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227971 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227974 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227976 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227979 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227981 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227986 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227988 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227991 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227993 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 18:07:23.232268 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227996 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.227999 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228002 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228004 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228007 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228009 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228012 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228014 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228017 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228019 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228022 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228024 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228027 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228029 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228032 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228035 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228037 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228040 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228043 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 18:07:23.232803 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228046 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228048 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228051 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228054 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228056 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228059 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228061 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228063 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228066 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228068 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228071 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228073 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228076 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228084 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228086 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228089 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228091 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228094 2556 feature_gate.go:328] unrecognized feature gate: Example Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228096 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228099 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 18:07:23.233271 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228190 2556 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228201 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228222 2556 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228229 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228235 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228238 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228243 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228248 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228251 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228255 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228258 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228262 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228265 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228268 2556 flags.go:64] FLAG: --cgroup-root="" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228271 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228274 2556 flags.go:64] FLAG: --client-ca-file="" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228285 2556 flags.go:64] FLAG: --cloud-provider="external" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228288 2556 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228295 2556 flags.go:64] FLAG: --cluster-domain="" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228297 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228301 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228304 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228307 2556 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228311 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 18:07:23.233780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228314 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228319 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228322 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228325 2556 flags.go:64] FLAG: --contention-profiling="false" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228328 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228331 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228335 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228339 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228344 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228347 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228350 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228355 2556 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228359 2556 flags.go:64] FLAG: --enable-server="true" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228362 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228368 2556 flags.go:64] FLAG: --event-burst="100" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228371 2556 flags.go:64] FLAG: --event-qps="50" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228386 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228390 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228393 2556 flags.go:64] FLAG: --eviction-hard="" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228397 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228400 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228403 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228406 2556 flags.go:64] FLAG: --eviction-soft="" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228409 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228412 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 18:07:23.234428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228415 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228418 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228421 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228424 2556 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228427 2556 flags.go:64] FLAG: --feature-gates="" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228431 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228434 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228437 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228441 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228444 2556 flags.go:64] FLAG: --healthz-port="10248" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228447 2556 flags.go:64] FLAG: --help="false" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228450 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228453 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228456 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228458 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228462 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228465 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228468 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228473 2556 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228475 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228478 2556 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228481 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228484 2556 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228487 2556 flags.go:64] FLAG: --kube-reserved="" Jun 08 18:07:23.235076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228490 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228493 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228496 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228499 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228502 2556 flags.go:64] FLAG: --lock-file="" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228504 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228507 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228510 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228516 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228519 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228522 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228525 2556 flags.go:64] FLAG: --logging-format="text" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228527 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228531 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228534 2556 flags.go:64] FLAG: --manifest-url="" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228537 2556 flags.go:64] FLAG: --manifest-url-header="" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228541 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228545 2556 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228553 2556 flags.go:64] FLAG: --max-pods="110" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228556 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228559 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228562 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228565 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228568 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228571 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 18:07:23.235743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228574 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228583 2556 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228586 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228589 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228592 2556 flags.go:64] FLAG: --pod-cidr="" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228595 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228600 2556 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228603 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228606 2556 flags.go:64] FLAG: --pods-per-core="0" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228610 2556 flags.go:64] FLAG: --port="10250" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228612 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228615 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0376f5115d8ec035d" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228619 2556 flags.go:64] FLAG: --qos-reserved="" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228621 2556 flags.go:64] FLAG: --read-only-port="10255" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228624 2556 flags.go:64] FLAG: --register-node="true" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228627 2556 flags.go:64] FLAG: --register-with-taints="" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228631 2556 flags.go:64] FLAG: --registry-burst="10" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228634 2556 flags.go:64] FLAG: --registry-qps="5" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228637 2556 flags.go:64] FLAG: --reserved-cpus="" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228640 2556 flags.go:64] FLAG: --reserved-memory="" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228644 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228646 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228649 2556 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228652 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228655 2556 flags.go:64] FLAG: --runonce="false" Jun 08 18:07:23.236366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228658 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228660 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228664 2556 flags.go:64] FLAG: --seccomp-default="false" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228667 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228669 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228672 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228675 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228678 2556 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228685 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228688 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228691 2556 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228694 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228697 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228700 2556 flags.go:64] FLAG: --system-cgroups="" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228702 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228708 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228710 2556 flags.go:64] FLAG: --tls-cert-file="" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228713 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228717 2556 flags.go:64] FLAG: --tls-min-version="" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228720 2556 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228723 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228725 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228728 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228731 2556 flags.go:64] FLAG: --v="2" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228735 2556 flags.go:64] FLAG: --version="false" Jun 08 18:07:23.237003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228740 2556 flags.go:64] FLAG: --vmodule="" Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228744 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.228747 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228867 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228871 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228874 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228876 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228879 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228882 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228885 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228887 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228890 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228892 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228895 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228897 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228902 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228904 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228907 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228909 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 18:07:23.237637 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228913 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228917 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228920 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228923 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228926 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228928 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228931 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228935 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228938 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228941 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228945 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228948 2556 feature_gate.go:328] unrecognized feature gate: Example Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228950 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228953 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228956 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228959 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228962 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228964 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228967 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228970 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 18:07:23.238111 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228972 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228975 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228978 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228980 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228982 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228985 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228988 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228990 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228995 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.228997 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229000 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229002 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229005 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229008 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229010 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229012 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229015 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229018 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229020 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229023 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 18:07:23.238623 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229025 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229028 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229032 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229035 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229037 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229040 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229042 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229045 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229048 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229050 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229053 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229056 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229058 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229061 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229063 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229066 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229069 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229071 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229074 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229076 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 18:07:23.239147 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229080 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229083 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229086 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229088 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229091 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229094 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229096 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229099 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229101 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229104 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229106 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229109 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229111 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229114 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229118 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229122 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229125 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229129 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229131 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 18:07:23.239719 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229134 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 18:07:23.240199 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229137 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 18:07:23.240199 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229140 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 18:07:23.240199 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.229143 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 18:07:23.240199 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.230226 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 18:07:23.240199 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.237564 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 18:07:23.240199 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.237582 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 18:07:23.240199 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.238545 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 18:07:23.240199 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.238552 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 18:07:23.240199 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238612 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 18:07:23.240199 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238617 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 18:07:23.240199 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238621 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 18:07:23.240199 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238624 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 18:07:23.240199 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238627 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 18:07:23.240199 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238631 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 18:07:23.240199 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238634 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238637 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238640 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238642 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238645 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238648 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238652 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238656 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238659 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238662 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238665 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238668 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238671 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238673 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238676 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238678 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238681 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238684 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238686 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238689 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 18:07:23.240598 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238691 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238694 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238697 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238701 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238704 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238707 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238709 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238712 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238714 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238717 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238719 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238722 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238724 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238727 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238729 2556 feature_gate.go:328] unrecognized feature gate: Example Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238732 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238735 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238737 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238739 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238742 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 18:07:23.241089 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238745 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238748 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238750 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238753 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238755 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238758 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238760 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238764 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238768 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238771 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238773 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238776 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238779 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238781 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238784 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238787 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238790 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238793 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238795 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 18:07:23.241634 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238798 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238800 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238803 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238806 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238808 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238810 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238813 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238816 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238818 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238821 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238823 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238826 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238828 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238831 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238833 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238835 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238838 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238841 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238844 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238846 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 18:07:23.242109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238849 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 18:07:23.242625 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238851 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 18:07:23.242625 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238854 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 18:07:23.242625 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238856 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 18:07:23.242625 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238858 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 18:07:23.242625 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238861 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 18:07:23.242625 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238863 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 18:07:23.242625 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238866 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 18:07:23.242625 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238869 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 18:07:23.242625 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238872 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 18:07:23.242625 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238875 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 18:07:23.242625 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238878 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 18:07:23.242625 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238880 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 18:07:23.242625 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.238884 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 18:07:23.242625 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.238890 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239014 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239019 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239022 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239025 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239028 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239031 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239033 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239036 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239039 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239042 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239045 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239047 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239050 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239053 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239056 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239058 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239061 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239063 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 18:07:23.242984 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239066 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239069 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239071 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239074 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239076 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239079 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239081 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239085 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239088 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239090 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239094 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239096 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239099 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239101 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239104 2556 feature_gate.go:328] unrecognized feature gate: Example Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239106 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239109 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239111 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239114 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239116 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 18:07:23.243470 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239119 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239121 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239124 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239127 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239129 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239132 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239136 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239139 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239142 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239145 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239148 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239151 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239154 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239157 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239161 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239165 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239167 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239170 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239172 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 18:07:23.243975 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239175 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239178 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239181 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239184 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239187 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239189 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239192 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239194 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239197 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239199 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239202 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239204 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239207 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239209 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239212 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239215 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239218 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239220 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239223 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239225 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 18:07:23.244453 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239228 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239230 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239233 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239235 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239239 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239242 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239245 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239248 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239251 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239254 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239257 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239260 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239262 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239265 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239267 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239270 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239272 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239275 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239278 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239280 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 18:07:23.244945 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239283 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 18:07:23.245460 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:23.239286 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 18:07:23.245460 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.239291 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 18:07:23.245460 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.239423 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 18:07:23.245460 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.241803 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 18:07:23.245460 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.243548 2556 server.go:1019] "Starting client certificate rotation" Jun 08 18:07:23.245460 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.243652 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 18:07:23.245460 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.243693 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 18:07:23.246508 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.246446 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 18:07:23.251807 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.251781 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 18:07:23.268008 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.267986 2556 log.go:25] "Validated CRI v1 runtime API" Jun 08 18:07:23.271682 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.271374 2556 log.go:25] "Validated CRI v1 image API" Jun 08 18:07:23.272698 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.272680 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 18:07:23.275489 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.275465 2556 fs.go:135] Filesystem UUIDs: map[5a89ffc5-e7fe-4c46-beb9-f32141284ec8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 90f0bc6f-6a66-4c5c-85ec-469edcf155e4:/dev/nvme0n1p4] Jun 08 18:07:23.275592 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.275486 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 18:07:23.276801 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.276782 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 18:07:23.281258 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.281132 2556 manager.go:216] Machine: {Timestamp:2026-06-08 18:07:23.27971773 +0000 UTC m=+0.376217192 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101680 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d5652d90868f43eeffe0c9696457c SystemUUID:ec2d5652-d908-68f4-3eef-fe0c9696457c BootID:a851bd3c-55b9-4316-b8f5-395d7a238cd2 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a8:ee:cb:9a:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a8:ee:cb:9a:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:00:fc:86:94:92 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 18:07:23.281258 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.281249 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 18:07:23.281434 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.281421 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 18:07:23.284942 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.284915 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 18:07:23.285084 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.284945 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-216.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 18:07:23.285798 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.285788 2556 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 18:07:23.285839 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.285801 2556 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 18:07:23.285839 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.285808 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 18:07:23.285839 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.285823 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 18:07:23.287177 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.287166 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 18:07:23.291611 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.291597 2556 state_mem.go:36] "Initialized new in-memory state store" Jun 08 18:07:23.291750 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.291739 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 18:07:23.291789 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.291777 2556 kubelet.go:486] "Attempting to sync node with API server" Jun 08 18:07:23.291789 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.291787 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 18:07:23.291857 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.291800 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 18:07:23.291857 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.291814 2556 kubelet.go:398] "Adding apiserver pod source" Jun 08 18:07:23.291936 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.291877 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 18:07:23.292342 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.292327 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 18:07:23.292431 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.292348 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 18:07:23.295264 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.295235 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 18:07:23.296944 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.296930 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 18:07:23.296994 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.296960 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 18:07:23.297774 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.297763 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 18:07:23.297833 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.297780 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 18:07:23.297833 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.297786 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 18:07:23.297833 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.297792 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 18:07:23.297833 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.297800 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 18:07:23.297833 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.297805 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 18:07:23.297833 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.297813 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 18:07:23.297833 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.297819 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 18:07:23.297833 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.297826 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 18:07:23.297833 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.297832 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 18:07:23.298092 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.297846 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 18:07:23.298092 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.297854 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 18:07:23.298919 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.298903 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 18:07:23.298919 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.298922 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 18:07:23.303513 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.303495 2556 server.go:1268] "Started kubelet" Jun 08 18:07:23.303641 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.303589 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 18:07:23.303682 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.303640 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 18:07:23.303713 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.303699 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 18:07:23.304571 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.304529 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 18:07:23.304729 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.304708 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 18:07:23.304864 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.304842 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-216.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 18:07:23.305145 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.305131 2556 server.go:310] "Adding debug handlers to kubelet server" Jun 08 18:07:23.305250 ip-10-0-140-216 systemd[1]: Started Kubernetes Kubelet. Jun 08 18:07:23.305834 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.305812 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 18:07:23.310582 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.309427 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-216.ec2.internal.18b72d5a40a959c0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-216.ec2.internal,UID:ip-10-0-140-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-216.ec2.internal,},FirstTimestamp:2026-06-08 18:07:23.303467456 +0000 UTC m=+0.399966917,LastTimestamp:2026-06-08 18:07:23.303467456 +0000 UTC m=+0.399966917,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-216.ec2.internal,}" Jun 08 18:07:23.313006 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.312970 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 18:07:23.313428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.313413 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 18:07:23.313428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.313421 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 18:07:23.313526 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.313487 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-216.ec2.internal\" not found" Jun 08 18:07:23.314410 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.314190 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 18:07:23.314528 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.314192 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 18:07:23.314611 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.314594 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 18:07:23.314715 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.314324 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 18:07:23.314715 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.314709 2556 reconstruct.go:97] "Volume reconstruction finished" Jun 08 18:07:23.314715 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.314717 2556 reconciler.go:29] "Reconciler: start to sync state" Jun 08 18:07:23.315003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.314720 2556 factory.go:55] Registering systemd factory Jun 08 18:07:23.315003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.314754 2556 factory.go:223] Registration of the systemd container factory successfully Jun 08 18:07:23.315220 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.315063 2556 factory.go:153] Registering CRI-O factory Jun 08 18:07:23.315220 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.315077 2556 factory.go:223] Registration of the crio container factory successfully Jun 08 18:07:23.315220 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.315099 2556 factory.go:103] Registering Raw factory Jun 08 18:07:23.315220 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.315114 2556 manager.go:1196] Started watching for new ooms in manager Jun 08 18:07:23.315624 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.315598 2556 manager.go:349] Starting recovery of all containers Jun 08 18:07:23.316754 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.316727 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-216.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 18:07:23.316861 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.316843 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 18:07:23.328310 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.328289 2556 manager.go:354] Recovery completed Jun 08 18:07:23.334308 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.334290 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 18:07:23.336776 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.336750 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasSufficientMemory" Jun 08 18:07:23.336862 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.336789 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 18:07:23.336862 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.336799 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasSufficientPID" Jun 08 18:07:23.337323 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.337310 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 18:07:23.337323 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.337321 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 18:07:23.337423 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.337323 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 18:07:23.337423 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.337369 2556 state_mem.go:36] "Initialized new in-memory state store" Jun 08 18:07:23.338116 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.338099 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasSufficientMemory" Jun 08 18:07:23.338155 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.338128 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 18:07:23.338155 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.338138 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasSufficientPID" Jun 08 18:07:23.338651 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.338575 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-216.ec2.internal.18b72d5a42a594b8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-216.ec2.internal,UID:ip-10-0-140-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-216.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-216.ec2.internal,},FirstTimestamp:2026-06-08 18:07:23.33677484 +0000 UTC m=+0.433274301,LastTimestamp:2026-06-08 18:07:23.33677484 +0000 UTC m=+0.433274301,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-216.ec2.internal,}" Jun 08 18:07:23.339654 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.339636 2556 policy_none.go:49] "None policy: Start" Jun 08 18:07:23.339654 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.339657 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 18:07:23.339761 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.339669 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 18:07:23.341469 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.341458 2556 policy_none.go:47] "Start" Jun 08 18:07:23.347565 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.347494 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-216.ec2.internal.18b72d5a42a5decf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-216.ec2.internal,UID:ip-10-0-140-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-216.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-216.ec2.internal,},FirstTimestamp:2026-06-08 18:07:23.336793807 +0000 UTC m=+0.433293268,LastTimestamp:2026-06-08 18:07:23.336793807 +0000 UTC m=+0.433293268,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-216.ec2.internal,}" Jun 08 18:07:23.349169 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.349096 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-216.ec2.internal.18b72d5a42a6013e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-216.ec2.internal,UID:ip-10-0-140-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-216.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-216.ec2.internal,},FirstTimestamp:2026-06-08 18:07:23.336802622 +0000 UTC m=+0.433302083,LastTimestamp:2026-06-08 18:07:23.336802622 +0000 UTC m=+0.433302083,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-216.ec2.internal,}" Jun 08 18:07:23.358765 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.358689 2556 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-216.ec2.internal.18b72d5a42a594b8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-216.ec2.internal.18b72d5a42a594b8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-216.ec2.internal,UID:ip-10-0-140-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-216.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-216.ec2.internal,},FirstTimestamp:2026-06-08 18:07:23.33677484 +0000 UTC m=+0.433274301,LastTimestamp:2026-06-08 18:07:23.338116593 +0000 UTC m=+0.434616056,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-216.ec2.internal,}" Jun 08 18:07:23.369467 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.369397 2556 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-216.ec2.internal.18b72d5a42a5decf\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-216.ec2.internal.18b72d5a42a5decf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-216.ec2.internal,UID:ip-10-0-140-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-216.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-216.ec2.internal,},FirstTimestamp:2026-06-08 18:07:23.336793807 +0000 UTC m=+0.433293268,LastTimestamp:2026-06-08 18:07:23.338132874 +0000 UTC m=+0.434632334,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-216.ec2.internal,}" Jun 08 18:07:23.379061 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.378981 2556 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-216.ec2.internal.18b72d5a42a6013e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-216.ec2.internal.18b72d5a42a6013e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-216.ec2.internal,UID:ip-10-0-140-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-216.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-216.ec2.internal,},FirstTimestamp:2026-06-08 18:07:23.336802622 +0000 UTC m=+0.433302083,LastTimestamp:2026-06-08 18:07:23.338142064 +0000 UTC m=+0.434641525,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-216.ec2.internal,}" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.382030 2556 manager.go:337] "Starting Device Plugin manager" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.382125 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.382140 2556 server.go:87] "Starting device plugin registration server" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.382449 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.382467 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.382562 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.382653 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.382663 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.383284 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.383330 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-216.ec2.internal\" not found" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.392163 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.393340 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.393405 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.393455 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.393510 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.394102 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-216.ec2.internal.18b72d5a458004f5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-216.ec2.internal,UID:ip-10-0-140-216.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-140-216.ec2.internal,},FirstTimestamp:2026-06-08 18:07:23.384644853 +0000 UTC m=+0.481144305,LastTimestamp:2026-06-08 18:07:23.384644853 +0000 UTC m=+0.481144305,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-216.ec2.internal,}" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.399761 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-knqjz" Jun 08 18:07:23.404038 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.403660 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 08 18:07:23.408057 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.408038 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-knqjz" Jun 08 18:07:23.483512 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.483434 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 18:07:23.484428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.484413 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasSufficientMemory" Jun 08 18:07:23.484490 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.484448 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 18:07:23.484490 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.484458 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasSufficientPID" Jun 08 18:07:23.484490 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.484483 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.493938 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.493914 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-216.ec2.internal"] Jun 08 18:07:23.494056 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.493977 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 18:07:23.495623 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.495605 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasSufficientMemory" Jun 08 18:07:23.495732 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.495632 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 18:07:23.495732 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.495642 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasSufficientPID" Jun 08 18:07:23.498111 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.498099 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 18:07:23.498231 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.498215 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.498279 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.498248 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 18:07:23.498819 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.498803 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasSufficientMemory" Jun 08 18:07:23.498909 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.498829 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 18:07:23.498909 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.498842 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasSufficientPID" Jun 08 18:07:23.498909 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.498809 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasSufficientMemory" Jun 08 18:07:23.498909 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.498891 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 18:07:23.498909 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.498900 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasSufficientPID" Jun 08 18:07:23.501178 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.501162 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.501290 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.501194 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 18:07:23.501488 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.501471 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.501570 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.501492 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-216.ec2.internal\": node \"ip-10-0-140-216.ec2.internal\" not found" Jun 08 18:07:23.501915 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.501897 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasSufficientMemory" Jun 08 18:07:23.501986 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.501924 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 18:07:23.501986 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.501934 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasSufficientPID" Jun 08 18:07:23.515397 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.515355 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8563d3f6ebccf3c4e3b70e40b52b60c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal\" (UID: \"c8563d3f6ebccf3c4e3b70e40b52b60c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.515397 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.515395 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8563d3f6ebccf3c4e3b70e40b52b60c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal\" (UID: \"c8563d3f6ebccf3c4e3b70e40b52b60c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.515571 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.515415 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5ed76c772cacd8817bd3f93664e5f5f7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-216.ec2.internal\" (UID: \"5ed76c772cacd8817bd3f93664e5f5f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.521032 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.521013 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-216.ec2.internal\" not found" node="ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.524669 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.524651 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-216.ec2.internal\" not found" node="ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.527913 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.527898 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-216.ec2.internal\" not found" Jun 08 18:07:23.615572 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.615542 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8563d3f6ebccf3c4e3b70e40b52b60c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal\" (UID: \"c8563d3f6ebccf3c4e3b70e40b52b60c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.615572 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.615572 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8563d3f6ebccf3c4e3b70e40b52b60c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal\" (UID: \"c8563d3f6ebccf3c4e3b70e40b52b60c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.615783 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.615599 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5ed76c772cacd8817bd3f93664e5f5f7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-216.ec2.internal\" (UID: \"5ed76c772cacd8817bd3f93664e5f5f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.615783 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.615643 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c8563d3f6ebccf3c4e3b70e40b52b60c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal\" (UID: \"c8563d3f6ebccf3c4e3b70e40b52b60c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.615783 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.615666 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8563d3f6ebccf3c4e3b70e40b52b60c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal\" (UID: \"c8563d3f6ebccf3c4e3b70e40b52b60c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.615783 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.615708 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5ed76c772cacd8817bd3f93664e5f5f7-config\") pod \"kube-apiserver-proxy-ip-10-0-140-216.ec2.internal\" (UID: \"5ed76c772cacd8817bd3f93664e5f5f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.628667 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.628640 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-216.ec2.internal\" not found" Jun 08 18:07:23.729470 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.729433 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-216.ec2.internal\" not found" Jun 08 18:07:23.828390 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.828295 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.830507 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.830480 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-216.ec2.internal\" not found" Jun 08 18:07:23.831304 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:23.831285 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-216.ec2.internal" Jun 08 18:07:23.930979 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:23.930937 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-216.ec2.internal\" not found" Jun 08 18:07:24.031581 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:24.031551 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-216.ec2.internal\" not found" Jun 08 18:07:24.132407 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:24.132299 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-216.ec2.internal\" not found" Jun 08 18:07:24.232935 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:24.232885 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-216.ec2.internal\" not found" Jun 08 18:07:24.243074 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.243052 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 18:07:24.333907 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:24.333875 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-216.ec2.internal\" not found" Jun 08 18:07:24.375477 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:24.375438 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8563d3f6ebccf3c4e3b70e40b52b60c.slice/crio-9e4e8d6a155b6db5f645744a7297c3d18c41779d734368007b2fb41d9aefcdc8 WatchSource:0}: Error finding container 9e4e8d6a155b6db5f645744a7297c3d18c41779d734368007b2fb41d9aefcdc8: Status 404 returned error can't find the container with id 9e4e8d6a155b6db5f645744a7297c3d18c41779d734368007b2fb41d9aefcdc8 Jun 08 18:07:24.375742 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:24.375726 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ed76c772cacd8817bd3f93664e5f5f7.slice/crio-3b2d670225e9a943c8e58545b3bd1ea2f99d448fc7443bede353dc6444d30ac9 WatchSource:0}: Error finding container 3b2d670225e9a943c8e58545b3bd1ea2f99d448fc7443bede353dc6444d30ac9: Status 404 returned error can't find the container with id 3b2d670225e9a943c8e58545b3bd1ea2f99d448fc7443bede353dc6444d30ac9 Jun 08 18:07:24.381500 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.381479 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 18:07:24.397016 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.396967 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-216.ec2.internal" event={"ID":"5ed76c772cacd8817bd3f93664e5f5f7","Type":"ContainerStarted","Data":"3b2d670225e9a943c8e58545b3bd1ea2f99d448fc7443bede353dc6444d30ac9"} Jun 08 18:07:24.398105 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.398079 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal" event={"ID":"c8563d3f6ebccf3c4e3b70e40b52b60c","Type":"ContainerStarted","Data":"9e4e8d6a155b6db5f645744a7297c3d18c41779d734368007b2fb41d9aefcdc8"} Jun 08 18:07:24.412332 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.412289 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 18:02:23 +0000 UTC" deadline="2027-12-11 17:56:43.486510928 +0000 UTC" Jun 08 18:07:24.412332 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.412324 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13223h49m19.074191244s" Jun 08 18:07:24.418689 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.418670 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 18:07:24.419636 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.419617 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasSufficientMemory" Jun 08 18:07:24.419725 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.419655 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 18:07:24.419725 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.419695 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeHasSufficientPID" Jun 08 18:07:24.434665 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:24.434639 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-216.ec2.internal\" not found" Jun 08 18:07:24.436023 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.436008 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 18:07:24.514465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.514419 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-216.ec2.internal" Jun 08 18:07:24.525449 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.525424 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 18:07:24.527288 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.527274 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal" Jun 08 18:07:24.539983 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.539958 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 18:07:24.782794 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.782769 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 18:07:24.801965 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.801926 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 18:07:24.829078 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:24.829049 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 18:07:25.293172 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.293133 2556 apiserver.go:52] "Watching apiserver" Jun 08 18:07:25.302601 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.302408 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 18:07:25.302947 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.302918 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal","openshift-multus/multus-additional-cni-plugins-nvptr","openshift-multus/multus-jfw94","openshift-network-diagnostics/network-check-target-zxnpb","kube-system/konnectivity-agent-2qjjd","openshift-cluster-node-tuning-operator/tuned-z62kj","openshift-dns/node-resolver-9fxrg","openshift-image-registry/node-ca-68pd6","openshift-multus/network-metrics-daemon-prs9q","openshift-network-operator/iptables-alerter-hns6n","openshift-ovn-kubernetes/ovnkube-node-pb7h4","kube-system/global-pull-secret-syncer-67m2r","kube-system/kube-apiserver-proxy-ip-10-0-140-216.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw"] Jun 08 18:07:25.305925 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.305866 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9fxrg" Jun 08 18:07:25.308159 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.308044 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.308561 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.308540 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 18:07:25.309221 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.309202 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-prsh6\"" Jun 08 18:07:25.309306 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.309205 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 18:07:25.310353 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.310318 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.310497 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.310479 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 18:07:25.311172 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.311015 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bf9nz\"" Jun 08 18:07:25.311893 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.311872 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 18:07:25.311996 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.311934 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 18:07:25.312196 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.312170 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 18:07:25.312280 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.312231 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 18:07:25.312452 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.312436 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 18:07:25.312452 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.312446 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 18:07:25.312759 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.312731 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 18:07:25.312851 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.312775 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 18:07:25.312851 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.312839 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cpvc7\"" Jun 08 18:07:25.313022 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.313004 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:25.313133 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.313053 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 18:07:25.313133 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:25.313071 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:25.314155 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.314112 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 18:07:25.315341 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.314964 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2qjjd" Jun 08 18:07:25.317423 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.317156 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.317423 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.317165 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 18:07:25.317423 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.317301 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 18:07:25.317423 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.317301 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zw2qw\"" Jun 08 18:07:25.319262 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.319201 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 18:07:25.319497 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.319481 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wfp4h\"" Jun 08 18:07:25.319497 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.319509 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 18:07:25.319833 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.319800 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:25.319890 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:25.319865 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:25.323703 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.323007 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.325474 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325452 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.325580 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325520 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-run-netns\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.325580 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325555 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.325696 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325580 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-env-overrides\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.325696 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325607 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-cnibin\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.325696 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325632 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c62cc930-9047-4238-9a59-ae0e6149f3b1-multus-daemon-config\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.325696 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325653 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nt65\" (UniqueName: \"kubernetes.io/projected/c62cc930-9047-4238-9a59-ae0e6149f3b1-kube-api-access-2nt65\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.325696 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325677 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-etc-openvswitch\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.325983 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325705 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-run-openvswitch\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.325983 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325729 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-cni-bin\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.325983 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325753 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-cni-netd\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.325983 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325775 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-run-netns\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.325983 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325797 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19721b88-ef0f-45e3-bbb2-5617aaeee3b5-tmp-dir\") pod \"node-resolver-9fxrg\" (UID: \"19721b88-ef0f-45e3-bbb2-5617aaeee3b5\") " pod="openshift-dns/node-resolver-9fxrg" Jun 08 18:07:25.325983 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325819 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vngjz\" (UniqueName: \"kubernetes.io/projected/19721b88-ef0f-45e3-bbb2-5617aaeee3b5-kube-api-access-vngjz\") pod \"node-resolver-9fxrg\" (UID: \"19721b88-ef0f-45e3-bbb2-5617aaeee3b5\") " pod="openshift-dns/node-resolver-9fxrg" Jun 08 18:07:25.325983 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325843 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-kubelet\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.325983 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325870 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-run-systemd\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.325983 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325896 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-multus-cni-dir\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.325983 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325920 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-multus-socket-dir-parent\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.325983 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.325954 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-var-lib-kubelet\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.326546 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326092 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-run-multus-certs\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.326546 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326121 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-run-ovn-kubernetes\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.326546 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326163 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-hostroot\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.326546 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326186 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-node-log\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.326546 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326309 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-ovn-node-metrics-cert\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.326546 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326338 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-system-cni-dir\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.326546 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326392 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-etc-kubernetes\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.326546 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326435 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e41bc240-74f7-4b2f-9227-74de729c6c28-konnectivity-ca\") pod \"konnectivity-agent-2qjjd\" (UID: \"e41bc240-74f7-4b2f-9227-74de729c6c28\") " pod="kube-system/konnectivity-agent-2qjjd" Jun 08 18:07:25.326546 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326461 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-log-socket\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.326546 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326524 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-ovnkube-script-lib\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.327067 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326548 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-os-release\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.327067 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326607 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-var-lib-cni-multus\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.327067 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326673 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhv8k\" (UniqueName: \"kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k\") pod \"network-check-target-zxnpb\" (UID: \"3ab47043-f5d8-4d33-8cd4-754c7ea81727\") " pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:25.327067 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326700 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-run-ovn\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.327067 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326744 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-ovnkube-config\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.327067 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326775 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpk64\" (UniqueName: \"kubernetes.io/projected/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-kube-api-access-cpk64\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.327067 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326827 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-run-k8s-cni-cncf-io\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.327067 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326884 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-var-lib-cni-bin\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.327067 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326907 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-multus-conf-dir\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.327067 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326928 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e41bc240-74f7-4b2f-9227-74de729c6c28-agent-certs\") pod \"konnectivity-agent-2qjjd\" (UID: \"e41bc240-74f7-4b2f-9227-74de729c6c28\") " pod="kube-system/konnectivity-agent-2qjjd" Jun 08 18:07:25.327067 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.326976 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-systemd-units\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.327067 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.327007 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-slash\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.327067 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.327049 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-var-lib-openvswitch\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.327897 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.327083 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c62cc930-9047-4238-9a59-ae0e6149f3b1-cni-binary-copy\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.327897 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.327107 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19721b88-ef0f-45e3-bbb2-5617aaeee3b5-hosts-file\") pod \"node-resolver-9fxrg\" (UID: \"19721b88-ef0f-45e3-bbb2-5617aaeee3b5\") " pod="openshift-dns/node-resolver-9fxrg" Jun 08 18:07:25.327897 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.327174 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 18:07:25.327897 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.327188 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 18:07:25.327897 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.327197 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 18:07:25.327897 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.327335 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 18:07:25.327897 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.327197 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vwswd\"" Jun 08 18:07:25.328305 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.327938 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-46dpx\"" Jun 08 18:07:25.328305 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.327973 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 18:07:25.328305 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.327994 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hns6n" Jun 08 18:07:25.328305 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.328194 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 18:07:25.330475 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.330360 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-68pd6" Jun 08 18:07:25.331089 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.331070 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z6zvd\"" Jun 08 18:07:25.331190 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.331102 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 18:07:25.331190 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.331147 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 18:07:25.331190 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.331105 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 18:07:25.332714 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.332563 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 18:07:25.332798 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.332779 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:25.332859 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:25.332836 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:25.332997 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.332977 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 18:07:25.333868 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.333706 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 18:07:25.333868 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.333759 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sxjbv\"" Jun 08 18:07:25.354580 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.354553 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xh8r5" Jun 08 18:07:25.364217 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.364107 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xh8r5" Jun 08 18:07:25.416204 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.416176 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 18:07:25.428524 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.428293 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-modprobe-d\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.428524 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.428372 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-kubernetes\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.428524 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.428434 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl7wn\" (UniqueName: \"kubernetes.io/projected/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-kube-api-access-pl7wn\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.428524 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.428473 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e41bc240-74f7-4b2f-9227-74de729c6c28-agent-certs\") pod \"konnectivity-agent-2qjjd\" (UID: \"e41bc240-74f7-4b2f-9227-74de729c6c28\") " pod="kube-system/konnectivity-agent-2qjjd" Jun 08 18:07:25.428823 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.428548 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-systemd-units\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.428823 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.428637 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-systemd-units\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.428823 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.428678 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-slash\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.428823 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.428758 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-slash\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.428823 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.428739 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-tuned\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.428823 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.428817 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-tmp\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.429206 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.428896 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2knhl\" (UniqueName: \"kubernetes.io/projected/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-kube-api-access-2knhl\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.429206 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.428936 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33e0074d-ecf4-4562-892c-c1a812e17ea2-host\") pod \"node-ca-68pd6\" (UID: \"33e0074d-ecf4-4562-892c-c1a812e17ea2\") " pod="openshift-image-registry/node-ca-68pd6" Jun 08 18:07:25.429206 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.428967 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.429206 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.429016 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs\") pod \"network-metrics-daemon-prs9q\" (UID: \"bd32751c-d426-4826-84a7-9f90d2bdc2de\") " pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:25.429206 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.429046 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret\") pod \"global-pull-secret-syncer-67m2r\" (UID: \"d0802022-961e-47d3-9708-d92ba53c576c\") " pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:25.429206 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.429077 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-cnibin\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.429206 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.429110 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-cni-bin\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.429206 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.429166 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-cni-netd\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.429206 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.429195 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-sysctl-d\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.429608 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.429227 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19721b88-ef0f-45e3-bbb2-5617aaeee3b5-tmp-dir\") pod \"node-resolver-9fxrg\" (UID: \"19721b88-ef0f-45e3-bbb2-5617aaeee3b5\") " pod="openshift-dns/node-resolver-9fxrg" Jun 08 18:07:25.429608 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.429254 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vngjz\" (UniqueName: \"kubernetes.io/projected/19721b88-ef0f-45e3-bbb2-5617aaeee3b5-kube-api-access-vngjz\") pod \"node-resolver-9fxrg\" (UID: \"19721b88-ef0f-45e3-bbb2-5617aaeee3b5\") " pod="openshift-dns/node-resolver-9fxrg" Jun 08 18:07:25.429608 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.429296 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-kubelet\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.429608 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.429401 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-cni-bin\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.429608 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.429488 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-sys\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.429608 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.429553 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-cnibin\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.429859 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.429635 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-cni-netd\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.432596 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.429978 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-registration-dir\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.432596 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.430049 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-kubelet\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.432596 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.430106 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-etc-selinux\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.432596 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.430240 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.432596 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.430280 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-multus-socket-dir-parent\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.432596 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.430329 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-var-lib-kubelet\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.432596 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.430341 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19721b88-ef0f-45e3-bbb2-5617aaeee3b5-tmp-dir\") pod \"node-resolver-9fxrg\" (UID: \"19721b88-ef0f-45e3-bbb2-5617aaeee3b5\") " pod="openshift-dns/node-resolver-9fxrg" Jun 08 18:07:25.432596 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.430447 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-multus-socket-dir-parent\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.432596 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.430974 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 18:07:25.432596 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.431408 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-var-lib-kubelet\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.432596 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.431456 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-run-multus-certs\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.433663 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.430361 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-run-multus-certs\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.433789 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.433682 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-cnibin\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.433789 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.433719 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-node-log\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.433789 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.433751 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-ovn-node-metrics-cert\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.433789 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.433779 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-system-cni-dir\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.433993 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.433806 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxrmw\" (UniqueName: \"kubernetes.io/projected/33e0074d-ecf4-4562-892c-c1a812e17ea2-kube-api-access-sxrmw\") pod \"node-ca-68pd6\" (UID: \"33e0074d-ecf4-4562-892c-c1a812e17ea2\") " pod="openshift-image-registry/node-ca-68pd6" Jun 08 18:07:25.433993 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.433840 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-system-cni-dir\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.433993 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.433872 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-sysctl-conf\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.433993 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.433903 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/92ef0fda-41a4-45dd-8367-1f25051fe94c-iptables-alerter-script\") pod \"iptables-alerter-hns6n\" (UID: \"92ef0fda-41a4-45dd-8367-1f25051fe94c\") " pod="openshift-network-operator/iptables-alerter-hns6n" Jun 08 18:07:25.433993 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.433936 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhv8k\" (UniqueName: \"kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k\") pod \"network-check-target-zxnpb\" (UID: \"3ab47043-f5d8-4d33-8cd4-754c7ea81727\") " pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:25.433993 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.433962 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92ef0fda-41a4-45dd-8367-1f25051fe94c-host-slash\") pod \"iptables-alerter-hns6n\" (UID: \"92ef0fda-41a4-45dd-8367-1f25051fe94c\") " pod="openshift-network-operator/iptables-alerter-hns6n" Jun 08 18:07:25.434296 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.433993 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d0802022-961e-47d3-9708-d92ba53c576c-dbus\") pod \"global-pull-secret-syncer-67m2r\" (UID: \"d0802022-961e-47d3-9708-d92ba53c576c\") " pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:25.434296 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434025 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-run-k8s-cni-cncf-io\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.434296 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434056 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-var-lib-cni-bin\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.434296 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434087 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-multus-conf-dir\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.434296 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-var-lib-openvswitch\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.434296 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434148 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.434296 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434180 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-env-overrides\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.434296 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434210 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-socket-dir\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.434296 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434244 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.434296 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434270 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c62cc930-9047-4238-9a59-ae0e6149f3b1-cni-binary-copy\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.434792 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434308 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19721b88-ef0f-45e3-bbb2-5617aaeee3b5-hosts-file\") pod \"node-resolver-9fxrg\" (UID: \"19721b88-ef0f-45e3-bbb2-5617aaeee3b5\") " pod="openshift-dns/node-resolver-9fxrg" Jun 08 18:07:25.434792 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434340 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-run-netns\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.434792 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434424 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-host\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.434792 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434453 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-device-dir\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.434792 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434485 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-sys-fs\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.434792 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434524 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzqqj\" (UniqueName: \"kubernetes.io/projected/bd32751c-d426-4826-84a7-9f90d2bdc2de-kube-api-access-rzqqj\") pod \"network-metrics-daemon-prs9q\" (UID: \"bd32751c-d426-4826-84a7-9f90d2bdc2de\") " pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:25.434792 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434559 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c62cc930-9047-4238-9a59-ae0e6149f3b1-multus-daemon-config\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.434792 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434591 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nt65\" (UniqueName: \"kubernetes.io/projected/c62cc930-9047-4238-9a59-ae0e6149f3b1-kube-api-access-2nt65\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.434792 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434618 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-etc-openvswitch\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.434792 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434656 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-run-openvswitch\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.434792 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434704 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-run\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.434792 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434736 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-lib-modules\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.434792 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434786 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.435478 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434819 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-run-netns\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.435478 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434867 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-run-systemd\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.435478 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.434955 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-run-systemd\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.435478 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.435458 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-env-overrides\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.435676 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.435569 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-sysconfig\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.435676 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.435625 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-var-lib-kubelet\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.435767 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.435668 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.435767 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.435712 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-multus-cni-dir\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.435767 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.435745 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-run-ovn-kubernetes\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.435912 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.435776 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-systemd\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.435912 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.435778 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c62cc930-9047-4238-9a59-ae0e6149f3b1-cni-binary-copy\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.435912 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.435809 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-os-release\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.435912 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.435870 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/19721b88-ef0f-45e3-bbb2-5617aaeee3b5-hosts-file\") pod \"node-resolver-9fxrg\" (UID: \"19721b88-ef0f-45e3-bbb2-5617aaeee3b5\") " pod="openshift-dns/node-resolver-9fxrg" Jun 08 18:07:25.436115 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.435919 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-node-log\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.436115 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.435950 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-run-netns\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.436115 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.435971 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/33e0074d-ecf4-4562-892c-c1a812e17ea2-serviceca\") pod \"node-ca-68pd6\" (UID: \"33e0074d-ecf4-4562-892c-c1a812e17ea2\") " pod="openshift-image-registry/node-ca-68pd6" Jun 08 18:07:25.436115 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.436090 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-system-cni-dir\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.436452 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-var-lib-cni-bin\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.436584 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-var-lib-openvswitch\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.436690 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-run-k8s-cni-cncf-io\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.436747 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-run-openvswitch\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.436798 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-etc-openvswitch\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.436821 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-multus-conf-dir\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.436840 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.436897 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c62cc930-9047-4238-9a59-ae0e6149f3b1-multus-daemon-config\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.436912 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-run-netns\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.436955 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-hostroot\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.436958 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-host-run-ovn-kubernetes\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.436990 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-multus-cni-dir\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437024 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sdgf\" (UniqueName: \"kubernetes.io/projected/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-kube-api-access-6sdgf\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437092 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-hostroot\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437115 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d0802022-961e-47d3-9708-d92ba53c576c-kubelet-config\") pod \"global-pull-secret-syncer-67m2r\" (UID: \"d0802022-961e-47d3-9708-d92ba53c576c\") " pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437157 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-etc-kubernetes\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437194 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e41bc240-74f7-4b2f-9227-74de729c6c28-konnectivity-ca\") pod \"konnectivity-agent-2qjjd\" (UID: \"e41bc240-74f7-4b2f-9227-74de729c6c28\") " pod="kube-system/konnectivity-agent-2qjjd" Jun 08 18:07:25.437465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437281 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-etc-kubernetes\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.438414 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437345 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-log-socket\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.438414 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437617 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-ovnkube-script-lib\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.438414 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437683 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-679tk\" (UniqueName: \"kubernetes.io/projected/92ef0fda-41a4-45dd-8367-1f25051fe94c-kube-api-access-679tk\") pod \"iptables-alerter-hns6n\" (UID: \"92ef0fda-41a4-45dd-8367-1f25051fe94c\") " pod="openshift-network-operator/iptables-alerter-hns6n" Jun 08 18:07:25.438414 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437775 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-os-release\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.438414 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437819 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-var-lib-cni-multus\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.438414 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437856 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-run-ovn\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.438414 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437867 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e41bc240-74f7-4b2f-9227-74de729c6c28-konnectivity-ca\") pod \"konnectivity-agent-2qjjd\" (UID: \"e41bc240-74f7-4b2f-9227-74de729c6c28\") " pod="kube-system/konnectivity-agent-2qjjd" Jun 08 18:07:25.438414 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437889 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-ovnkube-config\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.438414 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437945 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpk64\" (UniqueName: \"kubernetes.io/projected/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-kube-api-access-cpk64\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.438414 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437969 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-log-socket\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.438414 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437989 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-host-var-lib-cni-multus\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.438414 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.437989 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-run-ovn\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.440123 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.440069 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e41bc240-74f7-4b2f-9227-74de729c6c28-agent-certs\") pod \"konnectivity-agent-2qjjd\" (UID: \"e41bc240-74f7-4b2f-9227-74de729c6c28\") " pod="kube-system/konnectivity-agent-2qjjd" Jun 08 18:07:25.440230 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.440121 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c62cc930-9047-4238-9a59-ae0e6149f3b1-os-release\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.440586 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.440563 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vngjz\" (UniqueName: \"kubernetes.io/projected/19721b88-ef0f-45e3-bbb2-5617aaeee3b5-kube-api-access-vngjz\") pod \"node-resolver-9fxrg\" (UID: \"19721b88-ef0f-45e3-bbb2-5617aaeee3b5\") " pod="openshift-dns/node-resolver-9fxrg" Jun 08 18:07:25.440666 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.440647 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-ovnkube-config\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.440720 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.440647 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-ovnkube-script-lib\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.440931 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.440890 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-ovn-node-metrics-cert\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.443730 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:25.443708 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 18:07:25.443826 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:25.443735 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 18:07:25.443826 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:25.443763 2556 projected.go:196] Error preparing data for projected volume kube-api-access-hhv8k for pod openshift-network-diagnostics/network-check-target-zxnpb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:07:25.443929 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:25.443863 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k podName:3ab47043-f5d8-4d33-8cd4-754c7ea81727 nodeName:}" failed. No retries permitted until 2026-06-08 18:07:25.943833941 +0000 UTC m=+3.040333404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hhv8k" (UniqueName: "kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k") pod "network-check-target-zxnpb" (UID: "3ab47043-f5d8-4d33-8cd4-754c7ea81727") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:07:25.446934 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.446904 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nt65\" (UniqueName: \"kubernetes.io/projected/c62cc930-9047-4238-9a59-ae0e6149f3b1-kube-api-access-2nt65\") pod \"multus-jfw94\" (UID: \"c62cc930-9047-4238-9a59-ae0e6149f3b1\") " pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.449117 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.449098 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpk64\" (UniqueName: \"kubernetes.io/projected/b362d30f-bd8d-4a56-ae18-f05ebf4edb01-kube-api-access-cpk64\") pod \"ovnkube-node-pb7h4\" (UID: \"b362d30f-bd8d-4a56-ae18-f05ebf4edb01\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.539176 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539100 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-system-cni-dir\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.539176 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539132 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxrmw\" (UniqueName: \"kubernetes.io/projected/33e0074d-ecf4-4562-892c-c1a812e17ea2-kube-api-access-sxrmw\") pod \"node-ca-68pd6\" (UID: \"33e0074d-ecf4-4562-892c-c1a812e17ea2\") " pod="openshift-image-registry/node-ca-68pd6" Jun 08 18:07:25.539176 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539147 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-sysctl-conf\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.539176 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539170 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/92ef0fda-41a4-45dd-8367-1f25051fe94c-iptables-alerter-script\") pod \"iptables-alerter-hns6n\" (UID: \"92ef0fda-41a4-45dd-8367-1f25051fe94c\") " pod="openshift-network-operator/iptables-alerter-hns6n" Jun 08 18:07:25.539515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539208 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-system-cni-dir\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.539515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539248 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92ef0fda-41a4-45dd-8367-1f25051fe94c-host-slash\") pod \"iptables-alerter-hns6n\" (UID: \"92ef0fda-41a4-45dd-8367-1f25051fe94c\") " pod="openshift-network-operator/iptables-alerter-hns6n" Jun 08 18:07:25.539515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539287 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d0802022-961e-47d3-9708-d92ba53c576c-dbus\") pod \"global-pull-secret-syncer-67m2r\" (UID: \"d0802022-961e-47d3-9708-d92ba53c576c\") " pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:25.539515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539305 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-sysctl-conf\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.539515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539319 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-socket-dir\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.539515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539343 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.539515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539353 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/92ef0fda-41a4-45dd-8367-1f25051fe94c-host-slash\") pod \"iptables-alerter-hns6n\" (UID: \"92ef0fda-41a4-45dd-8367-1f25051fe94c\") " pod="openshift-network-operator/iptables-alerter-hns6n" Jun 08 18:07:25.539515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539373 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-host\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.539515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539424 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-device-dir\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.539515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539449 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-sys-fs\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.539515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539448 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-socket-dir\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.539515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539464 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-host\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.539515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539489 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzqqj\" (UniqueName: \"kubernetes.io/projected/bd32751c-d426-4826-84a7-9f90d2bdc2de-kube-api-access-rzqqj\") pod \"network-metrics-daemon-prs9q\" (UID: \"bd32751c-d426-4826-84a7-9f90d2bdc2de\") " pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:25.539515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539512 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-device-dir\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.539515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539524 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-run\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.540184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539536 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-sys-fs\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.540184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539566 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-run\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.540184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539568 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-lib-modules\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.540184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539602 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.540184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539631 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-sysconfig\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.540184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539648 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-lib-modules\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.540184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539656 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-var-lib-kubelet\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.540184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539618 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d0802022-961e-47d3-9708-d92ba53c576c-dbus\") pod \"global-pull-secret-syncer-67m2r\" (UID: \"d0802022-961e-47d3-9708-d92ba53c576c\") " pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:25.540184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539675 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.540184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539674 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-sysconfig\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.540184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539689 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.540184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539705 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-var-lib-kubelet\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.540184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539731 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-systemd\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.540184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539731 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/92ef0fda-41a4-45dd-8367-1f25051fe94c-iptables-alerter-script\") pod \"iptables-alerter-hns6n\" (UID: \"92ef0fda-41a4-45dd-8367-1f25051fe94c\") " pod="openshift-network-operator/iptables-alerter-hns6n" Jun 08 18:07:25.540184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539757 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-os-release\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.540184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539781 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/33e0074d-ecf4-4562-892c-c1a812e17ea2-serviceca\") pod \"node-ca-68pd6\" (UID: \"33e0074d-ecf4-4562-892c-c1a812e17ea2\") " pod="openshift-image-registry/node-ca-68pd6" Jun 08 18:07:25.540184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539809 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sdgf\" (UniqueName: \"kubernetes.io/projected/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-kube-api-access-6sdgf\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.540866 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539790 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-systemd\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.540866 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539835 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.540866 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539834 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d0802022-961e-47d3-9708-d92ba53c576c-kubelet-config\") pod \"global-pull-secret-syncer-67m2r\" (UID: \"d0802022-961e-47d3-9708-d92ba53c576c\") " pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:25.540866 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539847 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-os-release\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.540866 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539877 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-679tk\" (UniqueName: \"kubernetes.io/projected/92ef0fda-41a4-45dd-8367-1f25051fe94c-kube-api-access-679tk\") pod \"iptables-alerter-hns6n\" (UID: \"92ef0fda-41a4-45dd-8367-1f25051fe94c\") " pod="openshift-network-operator/iptables-alerter-hns6n" Jun 08 18:07:25.540866 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539883 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d0802022-961e-47d3-9708-d92ba53c576c-kubelet-config\") pod \"global-pull-secret-syncer-67m2r\" (UID: \"d0802022-961e-47d3-9708-d92ba53c576c\") " pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:25.540866 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539911 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.540866 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539912 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-modprobe-d\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.540866 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539963 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-kubernetes\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.540866 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.539988 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl7wn\" (UniqueName: \"kubernetes.io/projected/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-kube-api-access-pl7wn\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.540866 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540015 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-tuned\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.540866 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540024 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-modprobe-d\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.540866 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540039 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-tmp\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.540866 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540048 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-kubernetes\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.540866 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540103 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2knhl\" (UniqueName: \"kubernetes.io/projected/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-kube-api-access-2knhl\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.540866 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540128 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33e0074d-ecf4-4562-892c-c1a812e17ea2-host\") pod \"node-ca-68pd6\" (UID: \"33e0074d-ecf4-4562-892c-c1a812e17ea2\") " pod="openshift-image-registry/node-ca-68pd6" Jun 08 18:07:25.540866 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540132 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/33e0074d-ecf4-4562-892c-c1a812e17ea2-serviceca\") pod \"node-ca-68pd6\" (UID: \"33e0074d-ecf4-4562-892c-c1a812e17ea2\") " pod="openshift-image-registry/node-ca-68pd6" Jun 08 18:07:25.541408 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540157 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.541408 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540183 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs\") pod \"network-metrics-daemon-prs9q\" (UID: \"bd32751c-d426-4826-84a7-9f90d2bdc2de\") " pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:25.541408 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540194 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/33e0074d-ecf4-4562-892c-c1a812e17ea2-host\") pod \"node-ca-68pd6\" (UID: \"33e0074d-ecf4-4562-892c-c1a812e17ea2\") " pod="openshift-image-registry/node-ca-68pd6" Jun 08 18:07:25.541408 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540206 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret\") pod \"global-pull-secret-syncer-67m2r\" (UID: \"d0802022-961e-47d3-9708-d92ba53c576c\") " pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:25.541408 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540235 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-sysctl-d\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.541408 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540279 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-sys\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.541408 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540315 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-registration-dir\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.541408 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:25.540318 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:07:25.541408 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540340 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-etc-selinux\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.541408 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540368 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.541408 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:25.540402 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs podName:bd32751c-d426-4826-84a7-9f90d2bdc2de nodeName:}" failed. No retries permitted until 2026-06-08 18:07:26.040362884 +0000 UTC m=+3.136862359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs") pod "network-metrics-daemon-prs9q" (UID: "bd32751c-d426-4826-84a7-9f90d2bdc2de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:07:25.541408 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:25.540421 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 18:07:25.541408 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540440 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-cnibin\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.541408 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540419 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-sys\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.541408 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540462 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-sysctl-d\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.541408 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:25.540488 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret podName:d0802022-961e-47d3-9708-d92ba53c576c nodeName:}" failed. No retries permitted until 2026-06-08 18:07:26.040469835 +0000 UTC m=+3.136969297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret") pod "global-pull-secret-syncer-67m2r" (UID: "d0802022-961e-47d3-9708-d92ba53c576c") : object "kube-system"/"original-pull-secret" not registered Jun 08 18:07:25.541408 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540541 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-cnibin\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.541909 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540546 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-registration-dir\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.541909 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540570 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-etc-selinux\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.541909 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540732 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-cni-binary-copy\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.541909 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.540875 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.542144 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.542128 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-etc-tuned\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.542229 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.542215 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-tmp\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.551396 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.551358 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2knhl\" (UniqueName: \"kubernetes.io/projected/d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2-kube-api-access-2knhl\") pod \"aws-ebs-csi-driver-node-m4tdw\" (UID: \"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.551542 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.551408 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-679tk\" (UniqueName: \"kubernetes.io/projected/92ef0fda-41a4-45dd-8367-1f25051fe94c-kube-api-access-679tk\") pod \"iptables-alerter-hns6n\" (UID: \"92ef0fda-41a4-45dd-8367-1f25051fe94c\") " pod="openshift-network-operator/iptables-alerter-hns6n" Jun 08 18:07:25.551542 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.551434 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl7wn\" (UniqueName: \"kubernetes.io/projected/96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4-kube-api-access-pl7wn\") pod \"multus-additional-cni-plugins-nvptr\" (UID: \"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4\") " pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.551796 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.551769 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzqqj\" (UniqueName: \"kubernetes.io/projected/bd32751c-d426-4826-84a7-9f90d2bdc2de-kube-api-access-rzqqj\") pod \"network-metrics-daemon-prs9q\" (UID: \"bd32751c-d426-4826-84a7-9f90d2bdc2de\") " pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:25.551887 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.551834 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sdgf\" (UniqueName: \"kubernetes.io/projected/a084b337-7ed3-46fa-b4ab-b77adbd5af0e-kube-api-access-6sdgf\") pod \"tuned-z62kj\" (UID: \"a084b337-7ed3-46fa-b4ab-b77adbd5af0e\") " pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.551887 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.551878 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxrmw\" (UniqueName: \"kubernetes.io/projected/33e0074d-ecf4-4562-892c-c1a812e17ea2-kube-api-access-sxrmw\") pod \"node-ca-68pd6\" (UID: \"33e0074d-ecf4-4562-892c-c1a812e17ea2\") " pod="openshift-image-registry/node-ca-68pd6" Jun 08 18:07:25.619972 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.619769 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9fxrg" Jun 08 18:07:25.628738 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.628713 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:25.628927 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:25.628905 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19721b88_ef0f_45e3_bbb2_5617aaeee3b5.slice/crio-598412d0b4a66669d0296302dc4c4c8df2096c1203b78ccb50ab8c6cb30916b5 WatchSource:0}: Error finding container 598412d0b4a66669d0296302dc4c4c8df2096c1203b78ccb50ab8c6cb30916b5: Status 404 returned error can't find the container with id 598412d0b4a66669d0296302dc4c4c8df2096c1203b78ccb50ab8c6cb30916b5 Jun 08 18:07:25.637270 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:25.637236 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb362d30f_bd8d_4a56_ae18_f05ebf4edb01.slice/crio-96a511f4edb92e839ca1a0f57c6f8bf9f7ea8b92057808f4cc4ef407c3e9b1a5 WatchSource:0}: Error finding container 96a511f4edb92e839ca1a0f57c6f8bf9f7ea8b92057808f4cc4ef407c3e9b1a5: Status 404 returned error can't find the container with id 96a511f4edb92e839ca1a0f57c6f8bf9f7ea8b92057808f4cc4ef407c3e9b1a5 Jun 08 18:07:25.638915 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.638893 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jfw94" Jun 08 18:07:25.645204 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.645183 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2qjjd" Jun 08 18:07:25.649932 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:25.649899 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62cc930_9047_4238_9a59_ae0e6149f3b1.slice/crio-b8d9c78ec3ac76592bad4ec658e9d02a5e329440e88ca4da3ce224edc119a774 WatchSource:0}: Error finding container b8d9c78ec3ac76592bad4ec658e9d02a5e329440e88ca4da3ce224edc119a774: Status 404 returned error can't find the container with id b8d9c78ec3ac76592bad4ec658e9d02a5e329440e88ca4da3ce224edc119a774 Jun 08 18:07:25.651201 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.651180 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z62kj" Jun 08 18:07:25.656366 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:25.656328 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode41bc240_74f7_4b2f_9227_74de729c6c28.slice/crio-35dfe7d152213c54387b2e042118ba924706fcca3480985305beaa4aab34eb99 WatchSource:0}: Error finding container 35dfe7d152213c54387b2e042118ba924706fcca3480985305beaa4aab34eb99: Status 404 returned error can't find the container with id 35dfe7d152213c54387b2e042118ba924706fcca3480985305beaa4aab34eb99 Jun 08 18:07:25.659804 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.659725 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" Jun 08 18:07:25.660792 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:25.660764 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda084b337_7ed3_46fa_b4ab_b77adbd5af0e.slice/crio-562be9be61f575460fed8516dc0ad41880811bb01c845024207921d926b390bf WatchSource:0}: Error finding container 562be9be61f575460fed8516dc0ad41880811bb01c845024207921d926b390bf: Status 404 returned error can't find the container with id 562be9be61f575460fed8516dc0ad41880811bb01c845024207921d926b390bf Jun 08 18:07:25.667531 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.667514 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nvptr" Jun 08 18:07:25.669662 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:25.669640 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d58cd3_5e03_4681_b1f5_b6d4ef6ed2d2.slice/crio-98f9a10e05af45496da81cdc295ecd3d512e136cf75661af27d7313bca024821 WatchSource:0}: Error finding container 98f9a10e05af45496da81cdc295ecd3d512e136cf75661af27d7313bca024821: Status 404 returned error can't find the container with id 98f9a10e05af45496da81cdc295ecd3d512e136cf75661af27d7313bca024821 Jun 08 18:07:25.676857 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.676831 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hns6n" Jun 08 18:07:25.677109 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:25.677089 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96ec5f72_8ee7_45d8_8ac6_dcd44ca40fb4.slice/crio-6dc07ae7396338b80912e637a4209a7fe6cb115e54c99d9da455c5af91065a28 WatchSource:0}: Error finding container 6dc07ae7396338b80912e637a4209a7fe6cb115e54c99d9da455c5af91065a28: Status 404 returned error can't find the container with id 6dc07ae7396338b80912e637a4209a7fe6cb115e54c99d9da455c5af91065a28 Jun 08 18:07:25.683085 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:25.683063 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-68pd6" Jun 08 18:07:25.686918 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:25.686888 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ef0fda_41a4_45dd_8367_1f25051fe94c.slice/crio-3507e228435e95941a3381cd24c988c1af8851b018a0f556353393fd0a6abf3b WatchSource:0}: Error finding container 3507e228435e95941a3381cd24c988c1af8851b018a0f556353393fd0a6abf3b: Status 404 returned error can't find the container with id 3507e228435e95941a3381cd24c988c1af8851b018a0f556353393fd0a6abf3b Jun 08 18:07:25.691850 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:25.691827 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33e0074d_ecf4_4562_892c_c1a812e17ea2.slice/crio-d1e4de4d8eaa45bd76af299905b5fa2a1f7cf35b842e2f276142d2fb3eb99354 WatchSource:0}: Error finding container d1e4de4d8eaa45bd76af299905b5fa2a1f7cf35b842e2f276142d2fb3eb99354: Status 404 returned error can't find the container with id d1e4de4d8eaa45bd76af299905b5fa2a1f7cf35b842e2f276142d2fb3eb99354 Jun 08 18:07:26.044367 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:26.044335 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhv8k\" (UniqueName: \"kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k\") pod \"network-check-target-zxnpb\" (UID: \"3ab47043-f5d8-4d33-8cd4-754c7ea81727\") " pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:26.044565 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:26.044434 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs\") pod \"network-metrics-daemon-prs9q\" (UID: \"bd32751c-d426-4826-84a7-9f90d2bdc2de\") " pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:26.044565 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:26.044464 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret\") pod \"global-pull-secret-syncer-67m2r\" (UID: \"d0802022-961e-47d3-9708-d92ba53c576c\") " pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:26.044565 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:26.044534 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 18:07:26.044565 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:26.044560 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 18:07:26.044793 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:26.044574 2556 projected.go:196] Error preparing data for projected volume kube-api-access-hhv8k for pod openshift-network-diagnostics/network-check-target-zxnpb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:07:26.044793 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:26.044579 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 18:07:26.044793 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:26.044605 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:07:26.044793 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:26.044639 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret podName:d0802022-961e-47d3-9708-d92ba53c576c nodeName:}" failed. No retries permitted until 2026-06-08 18:07:27.044618272 +0000 UTC m=+4.141117724 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret") pod "global-pull-secret-syncer-67m2r" (UID: "d0802022-961e-47d3-9708-d92ba53c576c") : object "kube-system"/"original-pull-secret" not registered Jun 08 18:07:26.044793 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:26.044666 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k podName:3ab47043-f5d8-4d33-8cd4-754c7ea81727 nodeName:}" failed. No retries permitted until 2026-06-08 18:07:27.044649363 +0000 UTC m=+4.141148814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhv8k" (UniqueName: "kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k") pod "network-check-target-zxnpb" (UID: "3ab47043-f5d8-4d33-8cd4-754c7ea81727") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:07:26.044793 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:26.044699 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs podName:bd32751c-d426-4826-84a7-9f90d2bdc2de nodeName:}" failed. No retries permitted until 2026-06-08 18:07:27.044681531 +0000 UTC m=+4.141180980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs") pod "network-metrics-daemon-prs9q" (UID: "bd32751c-d426-4826-84a7-9f90d2bdc2de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:07:26.367457 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:26.367414 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 18:02:25 +0000 UTC" deadline="2028-03-17 23:07:36.690613094 +0000 UTC" Jun 08 18:07:26.367457 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:26.367454 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15557h0m10.323163312s" Jun 08 18:07:26.404405 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:26.404233 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" event={"ID":"b362d30f-bd8d-4a56-ae18-f05ebf4edb01","Type":"ContainerStarted","Data":"96a511f4edb92e839ca1a0f57c6f8bf9f7ea8b92057808f4cc4ef407c3e9b1a5"} Jun 08 18:07:26.409101 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:26.408756 2556 generic.go:356] "Generic (PLEG): container finished" podID="c8563d3f6ebccf3c4e3b70e40b52b60c" containerID="3f89024b4feefcd3c328313c69776fd6f3bcfe00ba281e4e77d4ec390149c047" exitCode=0 Jun 08 18:07:26.409101 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:26.408860 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal" event={"ID":"c8563d3f6ebccf3c4e3b70e40b52b60c","Type":"ContainerDied","Data":"3f89024b4feefcd3c328313c69776fd6f3bcfe00ba281e4e77d4ec390149c047"} Jun 08 18:07:26.412113 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:26.412085 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" event={"ID":"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2","Type":"ContainerStarted","Data":"98f9a10e05af45496da81cdc295ecd3d512e136cf75661af27d7313bca024821"} Jun 08 18:07:26.413809 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:26.413783 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z62kj" event={"ID":"a084b337-7ed3-46fa-b4ab-b77adbd5af0e","Type":"ContainerStarted","Data":"562be9be61f575460fed8516dc0ad41880811bb01c845024207921d926b390bf"} Jun 08 18:07:26.422768 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:26.422651 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2qjjd" event={"ID":"e41bc240-74f7-4b2f-9227-74de729c6c28","Type":"ContainerStarted","Data":"35dfe7d152213c54387b2e042118ba924706fcca3480985305beaa4aab34eb99"} Jun 08 18:07:26.430902 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:26.430586 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9fxrg" event={"ID":"19721b88-ef0f-45e3-bbb2-5617aaeee3b5","Type":"ContainerStarted","Data":"598412d0b4a66669d0296302dc4c4c8df2096c1203b78ccb50ab8c6cb30916b5"} Jun 08 18:07:26.432153 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:26.432097 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-68pd6" event={"ID":"33e0074d-ecf4-4562-892c-c1a812e17ea2","Type":"ContainerStarted","Data":"d1e4de4d8eaa45bd76af299905b5fa2a1f7cf35b842e2f276142d2fb3eb99354"} Jun 08 18:07:26.442316 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:26.438763 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hns6n" event={"ID":"92ef0fda-41a4-45dd-8367-1f25051fe94c","Type":"ContainerStarted","Data":"3507e228435e95941a3381cd24c988c1af8851b018a0f556353393fd0a6abf3b"} Jun 08 18:07:26.442316 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:26.441358 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nvptr" event={"ID":"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4","Type":"ContainerStarted","Data":"6dc07ae7396338b80912e637a4209a7fe6cb115e54c99d9da455c5af91065a28"} Jun 08 18:07:26.444843 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:26.444816 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jfw94" event={"ID":"c62cc930-9047-4238-9a59-ae0e6149f3b1","Type":"ContainerStarted","Data":"b8d9c78ec3ac76592bad4ec658e9d02a5e329440e88ca4da3ce224edc119a774"} Jun 08 18:07:27.053785 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:27.053736 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs\") pod \"network-metrics-daemon-prs9q\" (UID: \"bd32751c-d426-4826-84a7-9f90d2bdc2de\") " pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:27.053785 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:27.053790 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret\") pod \"global-pull-secret-syncer-67m2r\" (UID: \"d0802022-961e-47d3-9708-d92ba53c576c\") " pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:27.054012 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:27.053834 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhv8k\" (UniqueName: \"kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k\") pod \"network-check-target-zxnpb\" (UID: \"3ab47043-f5d8-4d33-8cd4-754c7ea81727\") " pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:27.054081 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:27.054018 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 18:07:27.054081 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:27.054041 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 18:07:27.054081 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:27.054054 2556 projected.go:196] Error preparing data for projected volume kube-api-access-hhv8k for pod openshift-network-diagnostics/network-check-target-zxnpb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:07:27.054218 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:27.054115 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k podName:3ab47043-f5d8-4d33-8cd4-754c7ea81727 nodeName:}" failed. No retries permitted until 2026-06-08 18:07:29.054097686 +0000 UTC m=+6.150597140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhv8k" (UniqueName: "kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k") pod "network-check-target-zxnpb" (UID: "3ab47043-f5d8-4d33-8cd4-754c7ea81727") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:07:27.054547 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:27.054403 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:07:27.054547 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:27.054419 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 18:07:27.054547 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:27.054460 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs podName:bd32751c-d426-4826-84a7-9f90d2bdc2de nodeName:}" failed. No retries permitted until 2026-06-08 18:07:29.054443894 +0000 UTC m=+6.150943346 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs") pod "network-metrics-daemon-prs9q" (UID: "bd32751c-d426-4826-84a7-9f90d2bdc2de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:07:27.054547 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:27.054490 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret podName:d0802022-961e-47d3-9708-d92ba53c576c nodeName:}" failed. No retries permitted until 2026-06-08 18:07:29.054469305 +0000 UTC m=+6.150968766 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret") pod "global-pull-secret-syncer-67m2r" (UID: "d0802022-961e-47d3-9708-d92ba53c576c") : object "kube-system"/"original-pull-secret" not registered Jun 08 18:07:27.367977 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:27.367925 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 18:02:25 +0000 UTC" deadline="2028-01-14 22:49:15.988737553 +0000 UTC" Jun 08 18:07:27.367977 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:27.367976 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14044h41m48.620765332s" Jun 08 18:07:27.395683 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:27.395598 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:27.395827 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:27.395733 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:27.396368 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:27.396129 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:27.396368 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:27.396247 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:27.396368 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:27.396344 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:27.396573 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:27.396440 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:27.456636 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:27.455973 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal" event={"ID":"c8563d3f6ebccf3c4e3b70e40b52b60c","Type":"ContainerStarted","Data":"59e8bc8b0787272eaae042ab1aabb209f0dc550d3e4cc1c336a930d06b1ff1fa"} Jun 08 18:07:27.462360 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:27.462325 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-216.ec2.internal" event={"ID":"5ed76c772cacd8817bd3f93664e5f5f7","Type":"ContainerStarted","Data":"f3a4c05f340103bb89d7f8e3aada397830ed461e566fd6d7f40937e21637abbc"} Jun 08 18:07:27.475013 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:27.471910 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-216.ec2.internal" podStartSLOduration=3.471889841 podStartE2EDuration="3.471889841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:07:27.471478452 +0000 UTC m=+4.567977927" watchObservedRunningTime="2026-06-08 18:07:27.471889841 +0000 UTC m=+4.568389313" Jun 08 18:07:29.073464 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:29.073423 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs\") pod \"network-metrics-daemon-prs9q\" (UID: \"bd32751c-d426-4826-84a7-9f90d2bdc2de\") " pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:29.073943 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:29.073491 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret\") pod \"global-pull-secret-syncer-67m2r\" (UID: \"d0802022-961e-47d3-9708-d92ba53c576c\") " pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:29.073943 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:29.073545 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhv8k\" (UniqueName: \"kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k\") pod \"network-check-target-zxnpb\" (UID: \"3ab47043-f5d8-4d33-8cd4-754c7ea81727\") " pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:29.073943 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:29.073721 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 18:07:29.073943 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:29.073746 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 18:07:29.073943 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:29.073762 2556 projected.go:196] Error preparing data for projected volume kube-api-access-hhv8k for pod openshift-network-diagnostics/network-check-target-zxnpb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:07:29.073943 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:29.073821 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k podName:3ab47043-f5d8-4d33-8cd4-754c7ea81727 nodeName:}" failed. No retries permitted until 2026-06-08 18:07:33.073803721 +0000 UTC m=+10.170303171 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhv8k" (UniqueName: "kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k") pod "network-check-target-zxnpb" (UID: "3ab47043-f5d8-4d33-8cd4-754c7ea81727") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:07:29.074246 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:29.074222 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:07:29.074301 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:29.074275 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs podName:bd32751c-d426-4826-84a7-9f90d2bdc2de nodeName:}" failed. No retries permitted until 2026-06-08 18:07:33.074260631 +0000 UTC m=+10.170760086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs") pod "network-metrics-daemon-prs9q" (UID: "bd32751c-d426-4826-84a7-9f90d2bdc2de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:07:29.074359 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:29.074336 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 18:07:29.074446 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:29.074370 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret podName:d0802022-961e-47d3-9708-d92ba53c576c nodeName:}" failed. No retries permitted until 2026-06-08 18:07:33.074358757 +0000 UTC m=+10.170858207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret") pod "global-pull-secret-syncer-67m2r" (UID: "d0802022-961e-47d3-9708-d92ba53c576c") : object "kube-system"/"original-pull-secret" not registered Jun 08 18:07:29.394460 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:29.394292 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:29.394460 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:29.394453 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:29.396849 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:29.394868 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:29.396849 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:29.394998 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:29.396849 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:29.395043 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:29.396849 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:29.395162 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:31.394750 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:31.394411 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:31.394750 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:31.394555 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:31.395327 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:31.394917 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:31.395327 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:31.395033 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:31.395327 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:31.395126 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:31.395327 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:31.395240 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:33.108225 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:33.108181 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs\") pod \"network-metrics-daemon-prs9q\" (UID: \"bd32751c-d426-4826-84a7-9f90d2bdc2de\") " pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:33.108743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:33.108238 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret\") pod \"global-pull-secret-syncer-67m2r\" (UID: \"d0802022-961e-47d3-9708-d92ba53c576c\") " pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:33.108743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:33.108285 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhv8k\" (UniqueName: \"kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k\") pod \"network-check-target-zxnpb\" (UID: \"3ab47043-f5d8-4d33-8cd4-754c7ea81727\") " pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:33.108743 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:33.108361 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:07:33.108743 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:33.108466 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 18:07:33.108743 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:33.108473 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 18:07:33.108743 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:33.108496 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 18:07:33.108743 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:33.108509 2556 projected.go:196] Error preparing data for projected volume kube-api-access-hhv8k for pod openshift-network-diagnostics/network-check-target-zxnpb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:07:33.108743 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:33.108530 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret podName:d0802022-961e-47d3-9708-d92ba53c576c nodeName:}" failed. No retries permitted until 2026-06-08 18:07:41.108509086 +0000 UTC m=+18.205008550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret") pod "global-pull-secret-syncer-67m2r" (UID: "d0802022-961e-47d3-9708-d92ba53c576c") : object "kube-system"/"original-pull-secret" not registered Jun 08 18:07:33.108743 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:33.108560 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k podName:3ab47043-f5d8-4d33-8cd4-754c7ea81727 nodeName:}" failed. No retries permitted until 2026-06-08 18:07:41.108544868 +0000 UTC m=+18.205044331 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhv8k" (UniqueName: "kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k") pod "network-check-target-zxnpb" (UID: "3ab47043-f5d8-4d33-8cd4-754c7ea81727") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:07:33.109225 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:33.108919 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs podName:bd32751c-d426-4826-84a7-9f90d2bdc2de nodeName:}" failed. No retries permitted until 2026-06-08 18:07:41.108902495 +0000 UTC m=+18.205401961 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs") pod "network-metrics-daemon-prs9q" (UID: "bd32751c-d426-4826-84a7-9f90d2bdc2de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:07:33.394705 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:33.394629 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:33.394861 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:33.394743 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:33.394861 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:33.394755 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:33.394970 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:33.394937 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:33.395039 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:33.395004 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:33.395130 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:33.395109 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:35.394464 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:35.394419 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:35.394913 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:35.394570 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:35.394913 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:35.394583 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:35.394913 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:35.394697 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:35.394913 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:35.394761 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:35.394913 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:35.394827 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:37.394174 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:37.394140 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:37.394683 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:37.394186 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:37.394683 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:37.394153 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:37.394683 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:37.394294 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:37.394683 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:37.394394 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:37.394683 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:37.394487 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:39.394009 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:39.393966 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:39.394439 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:39.394108 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:39.394439 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:39.394125 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:39.394439 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:39.394121 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:39.394439 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:39.394216 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:39.394439 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:39.394324 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:41.169547 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:41.169504 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs\") pod \"network-metrics-daemon-prs9q\" (UID: \"bd32751c-d426-4826-84a7-9f90d2bdc2de\") " pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:41.169547 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:41.169549 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret\") pod \"global-pull-secret-syncer-67m2r\" (UID: \"d0802022-961e-47d3-9708-d92ba53c576c\") " pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:41.170138 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:41.169578 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhv8k\" (UniqueName: \"kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k\") pod \"network-check-target-zxnpb\" (UID: \"3ab47043-f5d8-4d33-8cd4-754c7ea81727\") " pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:41.170138 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:41.169633 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:07:41.170138 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:41.169685 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 18:07:41.170138 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:41.169698 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 18:07:41.170138 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:41.169720 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs podName:bd32751c-d426-4826-84a7-9f90d2bdc2de nodeName:}" failed. No retries permitted until 2026-06-08 18:07:57.169697612 +0000 UTC m=+34.266197076 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs") pod "network-metrics-daemon-prs9q" (UID: "bd32751c-d426-4826-84a7-9f90d2bdc2de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:07:41.170138 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:41.169745 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret podName:d0802022-961e-47d3-9708-d92ba53c576c nodeName:}" failed. No retries permitted until 2026-06-08 18:07:57.169732403 +0000 UTC m=+34.266231863 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret") pod "global-pull-secret-syncer-67m2r" (UID: "d0802022-961e-47d3-9708-d92ba53c576c") : object "kube-system"/"original-pull-secret" not registered Jun 08 18:07:41.170138 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:41.169701 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 18:07:41.170138 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:41.169762 2556 projected.go:196] Error preparing data for projected volume kube-api-access-hhv8k for pod openshift-network-diagnostics/network-check-target-zxnpb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:07:41.170138 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:41.169792 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k podName:3ab47043-f5d8-4d33-8cd4-754c7ea81727 nodeName:}" failed. No retries permitted until 2026-06-08 18:07:57.169785405 +0000 UTC m=+34.266284867 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhv8k" (UniqueName: "kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k") pod "network-check-target-zxnpb" (UID: "3ab47043-f5d8-4d33-8cd4-754c7ea81727") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:07:41.394195 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:41.394155 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:41.394195 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:41.394185 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:41.394489 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:41.394156 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:41.394489 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:41.394294 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:41.394489 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:41.394364 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:41.394628 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:41.394502 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:43.396815 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:43.396785 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:43.397221 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:43.396793 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:43.397221 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:43.396885 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:43.397221 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:43.396793 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:43.397221 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:43.396974 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:43.397221 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:43.397034 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:45.395141 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.394666 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:45.395859 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.394747 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:45.395859 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:45.395281 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:45.395859 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.394759 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:45.395859 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:45.395348 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:45.395859 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:45.395491 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:45.504580 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.504545 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" event={"ID":"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2","Type":"ContainerStarted","Data":"dc70618a7251cf9676787764f7e20d8c08f55e12a1f14c4377ba42fe0ddd2212"} Jun 08 18:07:45.505853 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.505812 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z62kj" event={"ID":"a084b337-7ed3-46fa-b4ab-b77adbd5af0e","Type":"ContainerStarted","Data":"43878bd5796534757214ef3ed7aee3f79998f07b8304492ac75f94ac5cfd1d81"} Jun 08 18:07:45.507247 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.507205 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2qjjd" event={"ID":"e41bc240-74f7-4b2f-9227-74de729c6c28","Type":"ContainerStarted","Data":"5944181a3e2e7d30e1e3f4fca04dbe3e9fe9f6459f2130160dc032ef454c1f41"} Jun 08 18:07:45.508649 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.508616 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9fxrg" event={"ID":"19721b88-ef0f-45e3-bbb2-5617aaeee3b5","Type":"ContainerStarted","Data":"c98c5d721986d9255f374a0bb602f52480851d1af1ddc14214e571dfd4b10ffd"} Jun 08 18:07:45.510160 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.510135 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-68pd6" event={"ID":"33e0074d-ecf4-4562-892c-c1a812e17ea2","Type":"ContainerStarted","Data":"a137562d95ffe8ae12dbe0624ce1609155b078fc826992259a5ed97a71462671"} Jun 08 18:07:45.511828 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.511807 2556 generic.go:356] "Generic (PLEG): container finished" podID="96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4" containerID="aa67c01cd6ca540dd7955310a5c01bc2dd2b9d9d3aac889ac470450bce367e4a" exitCode=0 Jun 08 18:07:45.511941 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.511873 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nvptr" event={"ID":"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4","Type":"ContainerDied","Data":"aa67c01cd6ca540dd7955310a5c01bc2dd2b9d9d3aac889ac470450bce367e4a"} Jun 08 18:07:45.513418 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.513317 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jfw94" event={"ID":"c62cc930-9047-4238-9a59-ae0e6149f3b1","Type":"ContainerStarted","Data":"33af1a76bc6c299000664828981a35ac283f94d0b67ea655bcef89352d836fe9"} Jun 08 18:07:45.516179 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.516164 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb7h4_b362d30f-bd8d-4a56-ae18-f05ebf4edb01/ovn-acl-logging/0.log" Jun 08 18:07:45.516529 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.516510 2556 generic.go:356] "Generic (PLEG): container finished" podID="b362d30f-bd8d-4a56-ae18-f05ebf4edb01" containerID="81f34ad1dfc99bc2612a5d00527ecf0c7fd7b9aabbb2a88a16aba3c39fba1790" exitCode=1 Jun 08 18:07:45.516618 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.516542 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" event={"ID":"b362d30f-bd8d-4a56-ae18-f05ebf4edb01","Type":"ContainerStarted","Data":"47084863e526c014a0aa4df5bc30fa90e3e9e006fd53d92b9a72895ec7c8f5b5"} Jun 08 18:07:45.516618 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.516606 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" event={"ID":"b362d30f-bd8d-4a56-ae18-f05ebf4edb01","Type":"ContainerStarted","Data":"d858f4f3c40722d2845f0473ad88dbb43938982954baee7d14ff93b809537a98"} Jun 08 18:07:45.516724 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.516661 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" event={"ID":"b362d30f-bd8d-4a56-ae18-f05ebf4edb01","Type":"ContainerStarted","Data":"b7b6934a59eccd23a4114900a07daff0aee21ed5fc7855f62476fbcecc8fe6c5"} Jun 08 18:07:45.516724 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.516709 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" event={"ID":"b362d30f-bd8d-4a56-ae18-f05ebf4edb01","Type":"ContainerStarted","Data":"99d8b7e6556aed9e8cfbfdcac77b09422307eac64c064bdc7e5e16893b7f5de8"} Jun 08 18:07:45.516825 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.516758 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" event={"ID":"b362d30f-bd8d-4a56-ae18-f05ebf4edb01","Type":"ContainerDied","Data":"81f34ad1dfc99bc2612a5d00527ecf0c7fd7b9aabbb2a88a16aba3c39fba1790"} Jun 08 18:07:45.516825 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.516809 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" event={"ID":"b362d30f-bd8d-4a56-ae18-f05ebf4edb01","Type":"ContainerStarted","Data":"aec07a579522eb3db9c004da47237b91c35ebc579b7f9469c031100491891189"} Jun 08 18:07:45.522966 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.522912 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-216.ec2.internal" podStartSLOduration=21.522894405 podStartE2EDuration="21.522894405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:07:27.485828548 +0000 UTC m=+4.582328019" watchObservedRunningTime="2026-06-08 18:07:45.522894405 +0000 UTC m=+22.619393876" Jun 08 18:07:45.523497 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.523459 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z62kj" podStartSLOduration=3.417236516 podStartE2EDuration="22.52345073s" totalImagesPullingTime="19.106214214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:07:45.522667097 +0000 UTC m=+22.619166566" watchObservedRunningTime="2026-06-08 18:07:45.52345073 +0000 UTC m=+22.619950204" Jun 08 18:07:45.536592 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.536542 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9fxrg" podStartSLOduration=3.4331989 podStartE2EDuration="22.536527181s" totalImagesPullingTime="19.103328281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:07:45.536338663 +0000 UTC m=+22.632838135" watchObservedRunningTime="2026-06-08 18:07:45.536527181 +0000 UTC m=+22.633026651" Jun 08 18:07:45.580426 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.580308 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jfw94" podStartSLOduration=3.09149864 podStartE2EDuration="22.580285851s" totalImagesPullingTime="19.488787211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:07:45.562494121 +0000 UTC m=+22.658993590" watchObservedRunningTime="2026-06-08 18:07:45.580285851 +0000 UTC m=+22.676785319" Jun 08 18:07:45.580615 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.580498 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2qjjd" podStartSLOduration=7.698522204 podStartE2EDuration="22.580490069s" totalImagesPullingTime="14.881967865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:07:45.579900439 +0000 UTC m=+22.676399910" watchObservedRunningTime="2026-06-08 18:07:45.580490069 +0000 UTC m=+22.676989541" Jun 08 18:07:45.618851 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:45.618791 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-68pd6" podStartSLOduration=7.7720591930000005 podStartE2EDuration="22.618769389s" totalImagesPullingTime="14.846710196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:07:45.618619904 +0000 UTC m=+22.715119374" watchObservedRunningTime="2026-06-08 18:07:45.618769389 +0000 UTC m=+22.715268863" Jun 08 18:07:46.195005 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:46.194785 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 18:07:46.396108 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:46.395912 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T18:07:46.194999122Z","UUID":"7530243d-1f37-42b6-97a8-81529455bf80","Handler":null,"Name":"","Endpoint":""} Jun 08 18:07:46.397593 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:46.397573 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 18:07:46.397709 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:46.397618 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 18:07:46.520812 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:46.520774 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hns6n" event={"ID":"92ef0fda-41a4-45dd-8367-1f25051fe94c","Type":"ContainerStarted","Data":"23135ecbde0f4d9f847a42e30e430adecbd58d7aa9cab11b115a256bff4c7162"} Jun 08 18:07:46.523030 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:46.522994 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" event={"ID":"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2","Type":"ContainerStarted","Data":"197e7a5cb3a153479bc2c223039135f770dd4b56c35b020c263916e353970fd1"} Jun 08 18:07:46.538410 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:46.538350 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hns6n" podStartSLOduration=8.686767534 podStartE2EDuration="23.538334679s" totalImagesPullingTime="14.851567145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:07:46.537759682 +0000 UTC m=+23.634259243" watchObservedRunningTime="2026-06-08 18:07:46.538334679 +0000 UTC m=+23.634834148" Jun 08 18:07:47.394734 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:47.394706 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:47.394938 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:47.394706 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:47.394938 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:47.394870 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:47.394938 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:47.394919 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:47.395099 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:47.395004 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:47.395099 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:47.395066 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:47.529754 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:47.529718 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" event={"ID":"d8d58cd3-5e03-4681-b1f5-b6d4ef6ed2d2","Type":"ContainerStarted","Data":"117cb294aba9d0468232501791e4500c31c3c854767193f211503c85785eaca9"} Jun 08 18:07:47.548469 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:47.548426 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4tdw" podStartSLOduration=3.315058186 podStartE2EDuration="24.548410634s" totalImagesPullingTime="21.233352448s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:07:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:07:47.548012939 +0000 UTC m=+24.644512409" watchObservedRunningTime="2026-06-08 18:07:47.548410634 +0000 UTC m=+24.644910103" Jun 08 18:07:48.534487 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:48.534461 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb7h4_b362d30f-bd8d-4a56-ae18-f05ebf4edb01/ovn-acl-logging/0.log" Jun 08 18:07:48.535214 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:48.534879 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" event={"ID":"b362d30f-bd8d-4a56-ae18-f05ebf4edb01","Type":"ContainerStarted","Data":"41aaec10990debee138e3cd51a03f09ca9d2473eee9462966d4f7d753fe0254e"} Jun 08 18:07:49.171210 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:49.171175 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2qjjd" Jun 08 18:07:49.172055 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:49.172029 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2qjjd" Jun 08 18:07:49.393792 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:49.393712 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:49.393950 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:49.393725 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:49.393950 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:49.393830 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:49.393950 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:49.393854 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:49.394089 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:49.393972 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:49.394126 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:49.394092 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:49.537414 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:49.537367 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2qjjd" Jun 08 18:07:49.537949 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:49.537884 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2qjjd" Jun 08 18:07:50.541012 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:50.540825 2556 generic.go:356] "Generic (PLEG): container finished" podID="96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4" containerID="eadf6614ceef72d27ee260dfc362adadf958b42b61000e536477864a060689c6" exitCode=0 Jun 08 18:07:50.541858 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:50.540911 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nvptr" event={"ID":"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4","Type":"ContainerDied","Data":"eadf6614ceef72d27ee260dfc362adadf958b42b61000e536477864a060689c6"} Jun 08 18:07:50.544529 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:50.544505 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb7h4_b362d30f-bd8d-4a56-ae18-f05ebf4edb01/ovn-acl-logging/0.log" Jun 08 18:07:50.544944 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:50.544902 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" event={"ID":"b362d30f-bd8d-4a56-ae18-f05ebf4edb01","Type":"ContainerStarted","Data":"34f65f67f401c8dacba449e9118f1eb0c62aa9d8b57e079666c0dbe8b4b37717"} Jun 08 18:07:50.545370 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:50.545349 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:50.545462 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:50.545432 2556 scope.go:117] "RemoveContainer" containerID="81f34ad1dfc99bc2612a5d00527ecf0c7fd7b9aabbb2a88a16aba3c39fba1790" Jun 08 18:07:50.545518 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:50.545437 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:50.562551 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:50.562528 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:51.397573 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:51.397545 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:51.397788 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:51.397580 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:51.397788 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:51.397585 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:51.397788 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:51.397653 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:51.397788 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:51.397716 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:51.398021 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:51.397808 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:51.550518 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:51.550274 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nvptr" event={"ID":"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4","Type":"ContainerStarted","Data":"460bc85d5a015cda7cba789889ee328af35d23140d29e75f712cc3e22413abec"} Jun 08 18:07:51.554970 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:51.554940 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb7h4_b362d30f-bd8d-4a56-ae18-f05ebf4edb01/ovn-acl-logging/0.log" Jun 08 18:07:51.555637 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:51.555596 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" event={"ID":"b362d30f-bd8d-4a56-ae18-f05ebf4edb01","Type":"ContainerStarted","Data":"1c8d8599ed15f44a24c8527ba9ad750afafd105e085540f2ead63fae64ae40ef"} Jun 08 18:07:51.556051 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:51.556021 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:51.573627 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:51.573599 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:07:51.595335 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:51.595282 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" podStartSLOduration=9.466301712 podStartE2EDuration="28.595267787s" totalImagesPullingTime="19.128966075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:07:51.593985107 +0000 UTC m=+28.690484578" watchObservedRunningTime="2026-06-08 18:07:51.595267787 +0000 UTC m=+28.691767257" Jun 08 18:07:51.785365 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:51.785333 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-prs9q"] Jun 08 18:07:51.785546 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:51.785471 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:51.785599 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:51.785570 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:51.789571 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:51.789110 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zxnpb"] Jun 08 18:07:51.789571 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:51.789289 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:51.789571 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:51.789505 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:51.792235 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:51.790526 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-67m2r"] Jun 08 18:07:51.792235 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:51.790643 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:51.792235 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:51.790757 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:52.559300 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:52.559267 2556 generic.go:356] "Generic (PLEG): container finished" podID="96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4" containerID="460bc85d5a015cda7cba789889ee328af35d23140d29e75f712cc3e22413abec" exitCode=0 Jun 08 18:07:52.559800 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:52.559354 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nvptr" event={"ID":"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4","Type":"ContainerDied","Data":"460bc85d5a015cda7cba789889ee328af35d23140d29e75f712cc3e22413abec"} Jun 08 18:07:53.395348 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:53.395323 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:53.395529 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:53.395421 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:53.395529 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:53.395522 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:53.395645 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:53.395627 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:53.395694 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:53.395666 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:53.395762 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:53.395746 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:54.565981 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:54.565945 2556 generic.go:356] "Generic (PLEG): container finished" podID="96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4" containerID="c5a2f123bccee36d93f64ae7c1392e01984535cd53fd1e22b50ca96709ac695b" exitCode=0 Jun 08 18:07:54.566517 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:54.565997 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nvptr" event={"ID":"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4","Type":"ContainerDied","Data":"c5a2f123bccee36d93f64ae7c1392e01984535cd53fd1e22b50ca96709ac695b"} Jun 08 18:07:55.396856 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:55.396828 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:55.397057 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:55.396925 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:55.397057 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:55.396929 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:55.397057 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:55.396973 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:55.397210 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:55.397072 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:55.397210 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:55.397157 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:57.187164 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.187121 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs\") pod \"network-metrics-daemon-prs9q\" (UID: \"bd32751c-d426-4826-84a7-9f90d2bdc2de\") " pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:57.187164 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.187168 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret\") pod \"global-pull-secret-syncer-67m2r\" (UID: \"d0802022-961e-47d3-9708-d92ba53c576c\") " pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:57.187742 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.187203 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhv8k\" (UniqueName: \"kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k\") pod \"network-check-target-zxnpb\" (UID: \"3ab47043-f5d8-4d33-8cd4-754c7ea81727\") " pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:57.187742 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:57.187291 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:07:57.187742 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:57.187309 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 18:07:57.187742 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:57.187310 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 18:07:57.187742 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:57.187326 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 18:07:57.187742 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:57.187339 2556 projected.go:196] Error preparing data for projected volume kube-api-access-hhv8k for pod openshift-network-diagnostics/network-check-target-zxnpb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:07:57.187742 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:57.187357 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs podName:bd32751c-d426-4826-84a7-9f90d2bdc2de nodeName:}" failed. No retries permitted until 2026-06-08 18:08:29.18733802 +0000 UTC m=+66.283837488 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs") pod "network-metrics-daemon-prs9q" (UID: "bd32751c-d426-4826-84a7-9f90d2bdc2de") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 18:07:57.187742 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:57.187389 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k podName:3ab47043-f5d8-4d33-8cd4-754c7ea81727 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:29.187363198 +0000 UTC m=+66.283862663 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhv8k" (UniqueName: "kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k") pod "network-check-target-zxnpb" (UID: "3ab47043-f5d8-4d33-8cd4-754c7ea81727") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 18:07:57.187742 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:57.187407 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret podName:d0802022-961e-47d3-9708-d92ba53c576c nodeName:}" failed. No retries permitted until 2026-06-08 18:08:29.18739814 +0000 UTC m=+66.283897589 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret") pod "global-pull-secret-syncer-67m2r" (UID: "d0802022-961e-47d3-9708-d92ba53c576c") : object "kube-system"/"original-pull-secret" not registered Jun 08 18:07:57.393691 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.393656 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:57.393691 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.393676 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:57.393936 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:57.393779 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zxnpb" podUID="3ab47043-f5d8-4d33-8cd4-754c7ea81727" Jun 08 18:07:57.393936 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:57.393825 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:07:57.393936 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.393851 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:57.394211 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:57.393943 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-67m2r" podUID="d0802022-961e-47d3-9708-d92ba53c576c" Jun 08 18:07:57.754014 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.753989 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-216.ec2.internal" event="NodeReady" Jun 08 18:07:57.754183 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.754109 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 18:07:57.787320 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.787196 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6ddd65fc66-sln2l"] Jun 08 18:07:57.791594 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.791571 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.794930 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.794891 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 18:07:57.795164 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.795143 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c8ltj\"" Jun 08 18:07:57.795393 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.795359 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 18:07:57.799629 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.799050 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 18:07:57.800050 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.800032 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f2b89"] Jun 08 18:07:57.804586 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.804555 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t7hm6"] Jun 08 18:07:57.804801 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.804756 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 18:07:57.805175 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.805157 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f2b89" Jun 08 18:07:57.807485 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.807464 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 18:07:57.808015 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.807994 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9t8ln\"" Jun 08 18:07:57.808015 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.808005 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 18:07:57.809918 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.809893 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ddd65fc66-sln2l"] Jun 08 18:07:57.810026 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.810010 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t7hm6" Jun 08 18:07:57.812175 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.812157 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 18:07:57.812428 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.812408 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nrspc\"" Jun 08 18:07:57.812517 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.812461 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 18:07:57.812517 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.812410 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 18:07:57.817797 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.817762 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f2b89"] Jun 08 18:07:57.818584 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.818560 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t7hm6"] Jun 08 18:07:57.893079 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.893042 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-tmp-dir\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:07:57.893278 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.893088 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.893278 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.893112 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0de14d23-338d-40ba-a6c5-99db292ddb6d-cert\") pod \"ingress-canary-t7hm6\" (UID: \"0de14d23-338d-40ba-a6c5-99db292ddb6d\") " pod="openshift-ingress-canary/ingress-canary-t7hm6" Jun 08 18:07:57.893278 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.893134 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rsg4\" (UniqueName: \"kubernetes.io/projected/0de14d23-338d-40ba-a6c5-99db292ddb6d-kube-api-access-5rsg4\") pod \"ingress-canary-t7hm6\" (UID: \"0de14d23-338d-40ba-a6c5-99db292ddb6d\") " pod="openshift-ingress-canary/ingress-canary-t7hm6" Jun 08 18:07:57.893278 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.893198 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-config-volume\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:07:57.893278 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.893273 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/caba31aa-9b98-456d-94c4-2114b180472c-trusted-ca\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.893520 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.893302 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:07:57.893520 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.893321 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/caba31aa-9b98-456d-94c4-2114b180472c-registry-certificates\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.893520 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.893342 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xnml\" (UniqueName: \"kubernetes.io/projected/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-kube-api-access-2xnml\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:07:57.893520 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.893367 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/caba31aa-9b98-456d-94c4-2114b180472c-image-registry-private-configuration\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.893520 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.893452 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/caba31aa-9b98-456d-94c4-2114b180472c-installation-pull-secrets\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.893520 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.893496 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-bound-sa-token\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.893816 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.893537 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/caba31aa-9b98-456d-94c4-2114b180472c-ca-trust-extracted\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.893816 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.893611 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbs7k\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-kube-api-access-dbs7k\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.943084 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.943047 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:07:57.994913 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.994876 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-tmp-dir\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:07:57.994913 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.994918 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.995164 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.994942 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0de14d23-338d-40ba-a6c5-99db292ddb6d-cert\") pod \"ingress-canary-t7hm6\" (UID: \"0de14d23-338d-40ba-a6c5-99db292ddb6d\") " pod="openshift-ingress-canary/ingress-canary-t7hm6" Jun 08 18:07:57.995164 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.994967 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rsg4\" (UniqueName: \"kubernetes.io/projected/0de14d23-338d-40ba-a6c5-99db292ddb6d-kube-api-access-5rsg4\") pod \"ingress-canary-t7hm6\" (UID: \"0de14d23-338d-40ba-a6c5-99db292ddb6d\") " pod="openshift-ingress-canary/ingress-canary-t7hm6" Jun 08 18:07:57.995164 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.995035 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-config-volume\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:07:57.995164 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.995113 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/caba31aa-9b98-456d-94c4-2114b180472c-trusted-ca\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.995164 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:57.995049 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 18:07:57.995164 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.995150 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:07:57.995164 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:57.995158 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd65fc66-sln2l: secret "image-registry-tls" not found Jun 08 18:07:57.995531 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.995179 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/caba31aa-9b98-456d-94c4-2114b180472c-registry-certificates\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.995531 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:57.995221 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls podName:caba31aa-9b98-456d-94c4-2114b180472c nodeName:}" failed. No retries permitted until 2026-06-08 18:07:58.495201386 +0000 UTC m=+35.591700852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls") pod "image-registry-6ddd65fc66-sln2l" (UID: "caba31aa-9b98-456d-94c4-2114b180472c") : secret "image-registry-tls" not found Jun 08 18:07:57.995531 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.995246 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xnml\" (UniqueName: \"kubernetes.io/projected/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-kube-api-access-2xnml\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:07:57.995531 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.995285 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/caba31aa-9b98-456d-94c4-2114b180472c-image-registry-private-configuration\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.995531 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.995323 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/caba31aa-9b98-456d-94c4-2114b180472c-installation-pull-secrets\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.995531 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.995354 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-bound-sa-token\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.995531 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.995370 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-tmp-dir\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:07:57.995531 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.995437 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/caba31aa-9b98-456d-94c4-2114b180472c-ca-trust-extracted\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.995531 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:57.995511 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:07:57.995531 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.995516 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbs7k\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-kube-api-access-dbs7k\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.996011 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:57.995583 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls podName:b86ecae8-ac1d-4eb0-b49f-3b62e30cc190 nodeName:}" failed. No retries permitted until 2026-06-08 18:07:58.495561826 +0000 UTC m=+35.592061293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls") pod "dns-default-f2b89" (UID: "b86ecae8-ac1d-4eb0-b49f-3b62e30cc190") : secret "dns-default-metrics-tls" not found Jun 08 18:07:57.996011 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.995839 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-config-volume\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:07:57.996011 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.995919 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/caba31aa-9b98-456d-94c4-2114b180472c-registry-certificates\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.996127 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.996099 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/caba31aa-9b98-456d-94c4-2114b180472c-ca-trust-extracted\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.996739 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.996718 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/caba31aa-9b98-456d-94c4-2114b180472c-trusted-ca\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.999424 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.999396 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/caba31aa-9b98-456d-94c4-2114b180472c-image-registry-private-configuration\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:57.999424 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.999416 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0de14d23-338d-40ba-a6c5-99db292ddb6d-cert\") pod \"ingress-canary-t7hm6\" (UID: \"0de14d23-338d-40ba-a6c5-99db292ddb6d\") " pod="openshift-ingress-canary/ingress-canary-t7hm6" Jun 08 18:07:57.999587 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:57.999515 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/caba31aa-9b98-456d-94c4-2114b180472c-installation-pull-secrets\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:58.003539 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:58.003515 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rsg4\" (UniqueName: \"kubernetes.io/projected/0de14d23-338d-40ba-a6c5-99db292ddb6d-kube-api-access-5rsg4\") pod \"ingress-canary-t7hm6\" (UID: \"0de14d23-338d-40ba-a6c5-99db292ddb6d\") " pod="openshift-ingress-canary/ingress-canary-t7hm6" Jun 08 18:07:58.003741 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:58.003718 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-bound-sa-token\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:58.003841 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:58.003823 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbs7k\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-kube-api-access-dbs7k\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:58.003898 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:58.003880 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xnml\" (UniqueName: \"kubernetes.io/projected/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-kube-api-access-2xnml\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:07:58.037028 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:58.036984 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:07:58.125440 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:58.125188 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t7hm6" Jun 08 18:07:58.499689 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:58.499650 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:07:58.500146 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:58.499712 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:58.500146 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:58.499835 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:07:58.500146 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:58.499925 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls podName:b86ecae8-ac1d-4eb0-b49f-3b62e30cc190 nodeName:}" failed. No retries permitted until 2026-06-08 18:07:59.499904645 +0000 UTC m=+36.596404117 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls") pod "dns-default-f2b89" (UID: "b86ecae8-ac1d-4eb0-b49f-3b62e30cc190") : secret "dns-default-metrics-tls" not found Jun 08 18:07:58.500146 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:58.499843 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 18:07:58.500146 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:58.499942 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd65fc66-sln2l: secret "image-registry-tls" not found Jun 08 18:07:58.500146 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:58.499994 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls podName:caba31aa-9b98-456d-94c4-2114b180472c nodeName:}" failed. No retries permitted until 2026-06-08 18:07:59.499978966 +0000 UTC m=+36.596478419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls") pod "image-registry-6ddd65fc66-sln2l" (UID: "caba31aa-9b98-456d-94c4-2114b180472c") : secret "image-registry-tls" not found Jun 08 18:07:59.394334 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:59.394293 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:07:59.394534 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:59.394309 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:07:59.394534 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:59.394308 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:07:59.398982 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:59.397398 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 18:07:59.398982 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:59.397701 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 18:07:59.398982 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:59.398576 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cgshm\"" Jun 08 18:07:59.398982 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:59.398588 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 18:07:59.398982 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:59.398644 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 18:07:59.398982 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:59.398688 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bwmxt\"" Jun 08 18:07:59.426999 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:59.426957 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:07:59.507149 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:59.507114 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:07:59.507653 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:59.507214 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:07:59.507653 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:59.507288 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:07:59.507653 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:59.507359 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 18:07:59.507653 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:59.507373 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd65fc66-sln2l: secret "image-registry-tls" not found Jun 08 18:07:59.507653 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:59.507398 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls podName:b86ecae8-ac1d-4eb0-b49f-3b62e30cc190 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:01.507358813 +0000 UTC m=+38.603858271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls") pod "dns-default-f2b89" (UID: "b86ecae8-ac1d-4eb0-b49f-3b62e30cc190") : secret "dns-default-metrics-tls" not found Jun 08 18:07:59.507653 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:07:59.507454 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls podName:caba31aa-9b98-456d-94c4-2114b180472c nodeName:}" failed. No retries permitted until 2026-06-08 18:08:01.507436804 +0000 UTC m=+38.603936253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls") pod "image-registry-6ddd65fc66-sln2l" (UID: "caba31aa-9b98-456d-94c4-2114b180472c") : secret "image-registry-tls" not found Jun 08 18:07:59.525402 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:59.525335 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:07:59.683049 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:59.683017 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t7hm6"] Jun 08 18:07:59.687070 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:07:59.687042 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0de14d23_338d_40ba_a6c5_99db292ddb6d.slice/crio-041bebadfa39a4fa76c22308a9eac81e741b4f97afd17e0e251f11279c755901 WatchSource:0}: Error finding container 041bebadfa39a4fa76c22308a9eac81e741b4f97afd17e0e251f11279c755901: Status 404 returned error can't find the container with id 041bebadfa39a4fa76c22308a9eac81e741b4f97afd17e0e251f11279c755901 Jun 08 18:07:59.926484 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:07:59.926398 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:00.027035 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:00.026999 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:00.081107 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:00.081072 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:00.585046 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:00.585009 2556 generic.go:356] "Generic (PLEG): container finished" podID="96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4" containerID="6cd0a33d99639f9e4359b41ce9c0849dac1ff581886c9312bcb91b5d9b7c2b93" exitCode=0 Jun 08 18:08:00.585560 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:00.585095 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nvptr" event={"ID":"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4","Type":"ContainerDied","Data":"6cd0a33d99639f9e4359b41ce9c0849dac1ff581886c9312bcb91b5d9b7c2b93"} Jun 08 18:08:00.587766 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:00.587699 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t7hm6" event={"ID":"0de14d23-338d-40ba-a6c5-99db292ddb6d","Type":"ContainerStarted","Data":"041bebadfa39a4fa76c22308a9eac81e741b4f97afd17e0e251f11279c755901"} Jun 08 18:08:00.886313 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:00.886078 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:00.987165 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:00.987127 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:01.521337 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:01.521299 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:08:01.521521 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:01.521402 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:08:01.521521 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:01.521463 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:08:01.521521 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:01.521512 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 18:08:01.521521 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:01.521523 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd65fc66-sln2l: secret "image-registry-tls" not found Jun 08 18:08:01.521652 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:01.521527 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls podName:b86ecae8-ac1d-4eb0-b49f-3b62e30cc190 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:05.52151296 +0000 UTC m=+42.618012409 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls") pod "dns-default-f2b89" (UID: "b86ecae8-ac1d-4eb0-b49f-3b62e30cc190") : secret "dns-default-metrics-tls" not found Jun 08 18:08:01.521652 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:01.521559 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls podName:caba31aa-9b98-456d-94c4-2114b180472c nodeName:}" failed. No retries permitted until 2026-06-08 18:08:05.521549179 +0000 UTC m=+42.618048626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls") pod "image-registry-6ddd65fc66-sln2l" (UID: "caba31aa-9b98-456d-94c4-2114b180472c") : secret "image-registry-tls" not found Jun 08 18:08:01.593076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:01.592997 2556 generic.go:356] "Generic (PLEG): container finished" podID="96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4" containerID="6242e57bbcedcfdd58029fe560a51896ae9f5cc94320d46bc1ad9d1499c69a6a" exitCode=0 Jun 08 18:08:01.593076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:01.593066 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nvptr" event={"ID":"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4","Type":"ContainerDied","Data":"6242e57bbcedcfdd58029fe560a51896ae9f5cc94320d46bc1ad9d1499c69a6a"} Jun 08 18:08:01.817663 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:01.817567 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:02.116694 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:02.116650 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:02.598885 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:02.598853 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nvptr" event={"ID":"96ec5f72-8ee7-45d8-8ac6-dcd44ca40fb4","Type":"ContainerStarted","Data":"ad1a76d2ebb43ef3be41adb126af23dda593ec39ad92e8096e24692fc726785f"} Jun 08 18:08:02.624480 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:02.624422 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nvptr" podStartSLOduration=9.425987804 podStartE2EDuration="39.624404412s" totalImagesPullingTime="30.198416608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:07:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:08:02.622185618 +0000 UTC m=+39.718685088" watchObservedRunningTime="2026-06-08 18:08:02.624404412 +0000 UTC m=+39.720903876" Jun 08 18:08:02.745709 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:02.745676 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:02.844979 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:02.844938 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:03.602771 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:03.602732 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t7hm6" event={"ID":"0de14d23-338d-40ba-a6c5-99db292ddb6d","Type":"ContainerStarted","Data":"cbd1d2156d24224c5c0d590b8088770914644007c2c1e7182014b2a59810c812"} Jun 08 18:08:03.619019 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:03.618965 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t7hm6" podStartSLOduration=3.677661559 podStartE2EDuration="6.618949201s" totalImagesPullingTime="2.941287642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:08:03.617977364 +0000 UTC m=+40.714476834" watchObservedRunningTime="2026-06-08 18:08:03.618949201 +0000 UTC m=+40.715448662" Jun 08 18:08:05.555922 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:05.555881 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:08:05.556314 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:05.555977 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:08:05.556314 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:05.556046 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 18:08:05.556314 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:05.556064 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd65fc66-sln2l: secret "image-registry-tls" not found Jun 08 18:08:05.556314 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:05.556123 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:08:05.556314 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:05.556128 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls podName:caba31aa-9b98-456d-94c4-2114b180472c nodeName:}" failed. No retries permitted until 2026-06-08 18:08:13.556114672 +0000 UTC m=+50.652614134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls") pod "image-registry-6ddd65fc66-sln2l" (UID: "caba31aa-9b98-456d-94c4-2114b180472c") : secret "image-registry-tls" not found Jun 08 18:08:05.556314 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:05.556204 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls podName:b86ecae8-ac1d-4eb0-b49f-3b62e30cc190 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:13.556187667 +0000 UTC m=+50.652687115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls") pod "dns-default-f2b89" (UID: "b86ecae8-ac1d-4eb0-b49f-3b62e30cc190") : secret "dns-default-metrics-tls" not found Jun 08 18:08:09.431215 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:09.431180 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:09.488965 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:09.488926 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:09.538352 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:09.538311 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:10.502916 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:10.502881 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:10.551579 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:10.551547 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:12.553506 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:12.553469 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:12.605156 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:12.605118 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:13.439618 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:13.439583 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:13.615175 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:13.615137 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:08:13.615636 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:13.615206 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:08:13.615636 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:13.615291 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:08:13.615636 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:13.615326 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 18:08:13.615636 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:13.615351 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls podName:b86ecae8-ac1d-4eb0-b49f-3b62e30cc190 nodeName:}" failed. No retries permitted until 2026-06-08 18:08:29.615333183 +0000 UTC m=+66.711832650 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls") pod "dns-default-f2b89" (UID: "b86ecae8-ac1d-4eb0-b49f-3b62e30cc190") : secret "dns-default-metrics-tls" not found Jun 08 18:08:13.615636 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:13.615356 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd65fc66-sln2l: secret "image-registry-tls" not found Jun 08 18:08:13.615636 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:13.615431 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls podName:caba31aa-9b98-456d-94c4-2114b180472c nodeName:}" failed. No retries permitted until 2026-06-08 18:08:29.615413195 +0000 UTC m=+66.711912662 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls") pod "image-registry-6ddd65fc66-sln2l" (UID: "caba31aa-9b98-456d-94c4-2114b180472c") : secret "image-registry-tls" not found Jun 08 18:08:15.975467 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:15.975408 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:16.028511 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:16.028477 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:16.580844 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:16.580812 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:16.643798 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:16.643765 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:20.531553 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:20.531508 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:20.587238 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:20.587199 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:23.581470 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:23.581440 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pb7h4" Jun 08 18:08:23.737106 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:23.737068 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:23.787740 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:23.787708 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:29.229575 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.229519 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs\") pod \"network-metrics-daemon-prs9q\" (UID: \"bd32751c-d426-4826-84a7-9f90d2bdc2de\") " pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:08:29.229575 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.229578 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret\") pod \"global-pull-secret-syncer-67m2r\" (UID: \"d0802022-961e-47d3-9708-d92ba53c576c\") " pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:08:29.230073 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.229631 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhv8k\" (UniqueName: \"kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k\") pod \"network-check-target-zxnpb\" (UID: \"3ab47043-f5d8-4d33-8cd4-754c7ea81727\") " pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:08:29.232801 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.232779 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 18:08:29.233246 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.233233 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 18:08:29.233354 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.233337 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 18:08:29.240311 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:29.240290 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 18:08:29.240437 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:29.240370 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs podName:bd32751c-d426-4826-84a7-9f90d2bdc2de nodeName:}" failed. No retries permitted until 2026-06-08 18:09:33.240348433 +0000 UTC m=+130.336847882 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs") pod "network-metrics-daemon-prs9q" (UID: "bd32751c-d426-4826-84a7-9f90d2bdc2de") : secret "metrics-daemon-secret" not found Jun 08 18:08:29.242701 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.242684 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 18:08:29.243987 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.243965 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d0802022-961e-47d3-9708-d92ba53c576c-original-pull-secret\") pod \"global-pull-secret-syncer-67m2r\" (UID: \"d0802022-961e-47d3-9708-d92ba53c576c\") " pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:08:29.252752 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.252730 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhv8k\" (UniqueName: \"kubernetes.io/projected/3ab47043-f5d8-4d33-8cd4-754c7ea81727-kube-api-access-hhv8k\") pod \"network-check-target-zxnpb\" (UID: \"3ab47043-f5d8-4d33-8cd4-754c7ea81727\") " pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:08:29.411729 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.411703 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bwmxt\"" Jun 08 18:08:29.419133 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.419116 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:08:29.421447 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.421430 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-67m2r" Jun 08 18:08:29.592450 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.592409 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-67m2r"] Jun 08 18:08:29.600854 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.600817 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zxnpb"] Jun 08 18:08:29.611610 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:08:29.611585 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ab47043_f5d8_4d33_8cd4_754c7ea81727.slice/crio-c6666907029edcd83ec667c14b13fdbb5be1117ecf4eaba3df706eca15ca5772 WatchSource:0}: Error finding container c6666907029edcd83ec667c14b13fdbb5be1117ecf4eaba3df706eca15ca5772: Status 404 returned error can't find the container with id c6666907029edcd83ec667c14b13fdbb5be1117ecf4eaba3df706eca15ca5772 Jun 08 18:08:29.611996 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:08:29.611977 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0802022_961e_47d3_9708_d92ba53c576c.slice/crio-f3fe4578bad0fe25013e035b9226f32b0d91bb30c5f2bd98cb8b77e93d686b67 WatchSource:0}: Error finding container f3fe4578bad0fe25013e035b9226f32b0d91bb30c5f2bd98cb8b77e93d686b67: Status 404 returned error can't find the container with id f3fe4578bad0fe25013e035b9226f32b0d91bb30c5f2bd98cb8b77e93d686b67 Jun 08 18:08:29.632813 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.632782 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:08:29.632904 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.632837 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:08:29.632961 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:29.632926 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:08:29.632961 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:29.632936 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 18:08:29.632961 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:29.632960 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd65fc66-sln2l: secret "image-registry-tls" not found Jun 08 18:08:29.633074 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:29.632968 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls podName:b86ecae8-ac1d-4eb0-b49f-3b62e30cc190 nodeName:}" failed. No retries permitted until 2026-06-08 18:09:01.632955953 +0000 UTC m=+98.729455401 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls") pod "dns-default-f2b89" (UID: "b86ecae8-ac1d-4eb0-b49f-3b62e30cc190") : secret "dns-default-metrics-tls" not found Jun 08 18:08:29.633074 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:08:29.633011 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls podName:caba31aa-9b98-456d-94c4-2114b180472c nodeName:}" failed. No retries permitted until 2026-06-08 18:09:01.632996807 +0000 UTC m=+98.729496268 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls") pod "image-registry-6ddd65fc66-sln2l" (UID: "caba31aa-9b98-456d-94c4-2114b180472c") : secret "image-registry-tls" not found Jun 08 18:08:29.663156 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.663129 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zxnpb" event={"ID":"3ab47043-f5d8-4d33-8cd4-754c7ea81727","Type":"ContainerStarted","Data":"c6666907029edcd83ec667c14b13fdbb5be1117ecf4eaba3df706eca15ca5772"} Jun 08 18:08:29.664162 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:29.664142 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-67m2r" event={"ID":"d0802022-961e-47d3-9708-d92ba53c576c","Type":"ContainerStarted","Data":"f3fe4578bad0fe25013e035b9226f32b0d91bb30c5f2bd98cb8b77e93d686b67"} Jun 08 18:08:30.601287 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:30.601241 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:30.673964 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:30.673901 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:32.673346 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:32.673319 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zxnpb" event={"ID":"3ab47043-f5d8-4d33-8cd4-754c7ea81727","Type":"ContainerStarted","Data":"da24f0b0829edf90c3b9ba0f321d8267b8164b1eeda4cbf01fe5baf17bc54e92"} Jun 08 18:08:32.673704 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:32.673525 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:08:32.690426 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:32.690352 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zxnpb" podStartSLOduration=66.701652206 podStartE2EDuration="1m9.690338034s" totalImagesPullingTime="2.988685828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:08:32.689799263 +0000 UTC m=+69.786298736" watchObservedRunningTime="2026-06-08 18:08:32.690338034 +0000 UTC m=+69.786837536" Jun 08 18:08:32.888720 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:32.888630 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:32.946934 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:32.946896 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:34.679662 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:34.679627 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-67m2r" event={"ID":"d0802022-961e-47d3-9708-d92ba53c576c","Type":"ContainerStarted","Data":"4e0f214e4ff7002a2d805a6bf9b39cd69b6439d0b64bbce484208dad8726e50f"} Jun 08 18:08:37.958354 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:37.958317 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:38.023519 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:38.023476 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:42.171646 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:42.171614 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:42.228243 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:42.228209 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:57.564887 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:57.564766 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:57.629699 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:57.629660 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:08:57.701809 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:08:57.701779 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:09:01.661579 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:09:01.661483 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:09:01.661579 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:09:01.661537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:09:01.661955 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:09:01.661631 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 18:09:01.661955 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:09:01.661644 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd65fc66-sln2l: secret "image-registry-tls" not found Jun 08 18:09:01.661955 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:09:01.661632 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:09:01.661955 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:09:01.661704 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls podName:caba31aa-9b98-456d-94c4-2114b180472c nodeName:}" failed. No retries permitted until 2026-06-08 18:10:05.661691433 +0000 UTC m=+162.758190880 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls") pod "image-registry-6ddd65fc66-sln2l" (UID: "caba31aa-9b98-456d-94c4-2114b180472c") : secret "image-registry-tls" not found Jun 08 18:09:01.661955 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:09:01.661774 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls podName:b86ecae8-ac1d-4eb0-b49f-3b62e30cc190 nodeName:}" failed. No retries permitted until 2026-06-08 18:10:05.661761228 +0000 UTC m=+162.758260675 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls") pod "dns-default-f2b89" (UID: "b86ecae8-ac1d-4eb0-b49f-3b62e30cc190") : secret "dns-default-metrics-tls" not found Jun 08 18:09:03.678010 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:09:03.677980 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zxnpb" Jun 08 18:09:03.695186 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:09:03.695137 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-67m2r" podStartSLOduration=95.773590063 podStartE2EDuration="1m40.695122206s" totalImagesPullingTime="4.921532143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:08:34.697951035 +0000 UTC m=+71.794450507" watchObservedRunningTime="2026-06-08 18:09:03.695122206 +0000 UTC m=+100.791621678" Jun 08 18:09:33.291259 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:09:33.291211 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs\") pod \"network-metrics-daemon-prs9q\" (UID: \"bd32751c-d426-4826-84a7-9f90d2bdc2de\") " pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:09:33.291782 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:09:33.291367 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 18:09:33.291782 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:09:33.291450 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs podName:bd32751c-d426-4826-84a7-9f90d2bdc2de nodeName:}" failed. No retries permitted until 2026-06-08 18:11:35.29143603 +0000 UTC m=+252.387935481 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs") pod "network-metrics-daemon-prs9q" (UID: "bd32751c-d426-4826-84a7-9f90d2bdc2de") : secret "metrics-daemon-secret" not found Jun 08 18:10:00.806898 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:10:00.806833 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" podUID="caba31aa-9b98-456d-94c4-2114b180472c" Jun 08 18:10:00.817978 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:10:00.817934 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-f2b89" podUID="b86ecae8-ac1d-4eb0-b49f-3b62e30cc190" Jun 08 18:10:00.890139 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:10:00.890102 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:10:00.890310 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:10:00.890105 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f2b89" Jun 08 18:10:02.415709 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:10:02.415664 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:10:05.715910 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:10:05.715854 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:10:05.716417 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:10:05.715948 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:10:05.716417 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:10:05.716013 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 18:10:05.716417 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:10:05.716036 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6ddd65fc66-sln2l: secret "image-registry-tls" not found Jun 08 18:10:05.716417 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:10:05.716074 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 18:10:05.716417 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:10:05.716115 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls podName:caba31aa-9b98-456d-94c4-2114b180472c nodeName:}" failed. No retries permitted until 2026-06-08 18:12:07.716100165 +0000 UTC m=+284.812599630 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls") pod "image-registry-6ddd65fc66-sln2l" (UID: "caba31aa-9b98-456d-94c4-2114b180472c") : secret "image-registry-tls" not found Jun 08 18:10:05.716417 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:10:05.716137 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls podName:b86ecae8-ac1d-4eb0-b49f-3b62e30cc190 nodeName:}" failed. No retries permitted until 2026-06-08 18:12:07.716122131 +0000 UTC m=+284.812621585 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls") pod "dns-default-f2b89" (UID: "b86ecae8-ac1d-4eb0-b49f-3b62e30cc190") : secret "dns-default-metrics-tls" not found Jun 08 18:10:15.394110 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:10:15.394028 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:10:36.597702 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:10:36.597667 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:11:35.013905 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:35.013863 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:11:35.349229 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:35.349124 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs\") pod \"network-metrics-daemon-prs9q\" (UID: \"bd32751c-d426-4826-84a7-9f90d2bdc2de\") " pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:11:35.349412 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:35.349255 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 18:11:35.349412 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:35.349324 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs podName:bd32751c-d426-4826-84a7-9f90d2bdc2de nodeName:}" failed. No retries permitted until 2026-06-08 18:13:37.349308992 +0000 UTC m=+374.445808444 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs") pod "network-metrics-daemon-prs9q" (UID: "bd32751c-d426-4826-84a7-9f90d2bdc2de") : secret "metrics-daemon-secret" not found Jun 08 18:11:35.532437 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:35.532401 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:11:35.585809 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:35.585776 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:11:50.531082 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.530984 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf"] Jun 08 18:11:50.533698 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.533683 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf" Jun 08 18:11:50.536818 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.536795 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 08 18:11:50.536984 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.536836 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 08 18:11:50.536984 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.536872 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 08 18:11:50.537135 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.537120 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 08 18:11:50.537890 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.537872 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wcgct\"" Jun 08 18:11:50.554666 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.554631 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18f9c3f3-d6d4-4ffa-92f5-88f163256aaf-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f7zlf\" (UID: \"18f9c3f3-d6d4-4ffa-92f5-88f163256aaf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf" Jun 08 18:11:50.554834 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.554729 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqddq\" (UniqueName: \"kubernetes.io/projected/18f9c3f3-d6d4-4ffa-92f5-88f163256aaf-kube-api-access-wqddq\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f7zlf\" (UID: \"18f9c3f3-d6d4-4ffa-92f5-88f163256aaf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf" Jun 08 18:11:50.554834 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.554768 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18f9c3f3-d6d4-4ffa-92f5-88f163256aaf-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f7zlf\" (UID: \"18f9c3f3-d6d4-4ffa-92f5-88f163256aaf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf" Jun 08 18:11:50.559722 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.559690 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf"] Jun 08 18:11:50.621269 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.621235 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw"] Jun 08 18:11:50.623929 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.623913 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" Jun 08 18:11:50.626400 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.626366 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 08 18:11:50.626854 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.626837 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 18:11:50.628569 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.628551 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xxvzn\"" Jun 08 18:11:50.628666 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.628567 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 18:11:50.628666 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.628569 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 08 18:11:50.638632 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.638608 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw"] Jun 08 18:11:50.655541 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.655510 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-7qckw\" (UID: \"76e1a31b-3e39-472f-a4ef-9d53ebc7a59a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" Jun 08 18:11:50.655723 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.655564 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqddq\" (UniqueName: \"kubernetes.io/projected/18f9c3f3-d6d4-4ffa-92f5-88f163256aaf-kube-api-access-wqddq\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f7zlf\" (UID: \"18f9c3f3-d6d4-4ffa-92f5-88f163256aaf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf" Jun 08 18:11:50.655723 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.655589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2jcn\" (UniqueName: \"kubernetes.io/projected/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-kube-api-access-g2jcn\") pod \"cluster-monitoring-operator-74bbf69bbb-7qckw\" (UID: \"76e1a31b-3e39-472f-a4ef-9d53ebc7a59a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" Jun 08 18:11:50.655723 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.655611 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18f9c3f3-d6d4-4ffa-92f5-88f163256aaf-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f7zlf\" (UID: \"18f9c3f3-d6d4-4ffa-92f5-88f163256aaf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf" Jun 08 18:11:50.655723 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.655652 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18f9c3f3-d6d4-4ffa-92f5-88f163256aaf-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f7zlf\" (UID: \"18f9c3f3-d6d4-4ffa-92f5-88f163256aaf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf" Jun 08 18:11:50.655723 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.655671 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7qckw\" (UID: \"76e1a31b-3e39-472f-a4ef-9d53ebc7a59a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" Jun 08 18:11:50.656131 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.656113 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18f9c3f3-d6d4-4ffa-92f5-88f163256aaf-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f7zlf\" (UID: \"18f9c3f3-d6d4-4ffa-92f5-88f163256aaf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf" Jun 08 18:11:50.657917 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.657900 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18f9c3f3-d6d4-4ffa-92f5-88f163256aaf-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f7zlf\" (UID: \"18f9c3f3-d6d4-4ffa-92f5-88f163256aaf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf" Jun 08 18:11:50.672330 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.672296 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqddq\" (UniqueName: \"kubernetes.io/projected/18f9c3f3-d6d4-4ffa-92f5-88f163256aaf-kube-api-access-wqddq\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-f7zlf\" (UID: \"18f9c3f3-d6d4-4ffa-92f5-88f163256aaf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf" Jun 08 18:11:50.716032 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.716001 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq"] Jun 08 18:11:50.718856 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.718841 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq" Jun 08 18:11:50.721277 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.721244 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 08 18:11:50.721434 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.721298 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8hccm\"" Jun 08 18:11:50.721434 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.721410 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 08 18:11:50.730142 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.730110 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq"] Jun 08 18:11:50.756578 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.756537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7qckw\" (UID: \"76e1a31b-3e39-472f-a4ef-9d53ebc7a59a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" Jun 08 18:11:50.756578 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.756584 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c61949ce-e85f-4004-be6d-908faafb7aee-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-6mkhq\" (UID: \"c61949ce-e85f-4004-be6d-908faafb7aee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq" Jun 08 18:11:50.756833 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.756617 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-7qckw\" (UID: \"76e1a31b-3e39-472f-a4ef-9d53ebc7a59a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" Jun 08 18:11:50.756833 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.756637 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mkhq\" (UID: \"c61949ce-e85f-4004-be6d-908faafb7aee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq" Jun 08 18:11:50.756833 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:50.756709 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 18:11:50.756833 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:50.756769 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls podName:76e1a31b-3e39-472f-a4ef-9d53ebc7a59a nodeName:}" failed. No retries permitted until 2026-06-08 18:11:51.256755572 +0000 UTC m=+268.353255024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7qckw" (UID: "76e1a31b-3e39-472f-a4ef-9d53ebc7a59a") : secret "cluster-monitoring-operator-tls" not found Jun 08 18:11:50.756833 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.756709 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2jcn\" (UniqueName: \"kubernetes.io/projected/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-kube-api-access-g2jcn\") pod \"cluster-monitoring-operator-74bbf69bbb-7qckw\" (UID: \"76e1a31b-3e39-472f-a4ef-9d53ebc7a59a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" Jun 08 18:11:50.757262 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.757245 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-7qckw\" (UID: \"76e1a31b-3e39-472f-a4ef-9d53ebc7a59a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" Jun 08 18:11:50.767298 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.767269 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2jcn\" (UniqueName: \"kubernetes.io/projected/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-kube-api-access-g2jcn\") pod \"cluster-monitoring-operator-74bbf69bbb-7qckw\" (UID: \"76e1a31b-3e39-472f-a4ef-9d53ebc7a59a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" Jun 08 18:11:50.813756 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.813662 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:11:50.842533 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.842503 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf" Jun 08 18:11:50.857659 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.857629 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c61949ce-e85f-4004-be6d-908faafb7aee-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-6mkhq\" (UID: \"c61949ce-e85f-4004-be6d-908faafb7aee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq" Jun 08 18:11:50.857804 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.857693 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mkhq\" (UID: \"c61949ce-e85f-4004-be6d-908faafb7aee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq" Jun 08 18:11:50.857863 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:50.857811 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 18:11:50.857913 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:50.857877 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert podName:c61949ce-e85f-4004-be6d-908faafb7aee nodeName:}" failed. No retries permitted until 2026-06-08 18:11:51.357861505 +0000 UTC m=+268.454360970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6mkhq" (UID: "c61949ce-e85f-4004-be6d-908faafb7aee") : secret "networking-console-plugin-cert" not found Jun 08 18:11:50.858369 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.858347 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c61949ce-e85f-4004-be6d-908faafb7aee-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-6mkhq\" (UID: \"c61949ce-e85f-4004-be6d-908faafb7aee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq" Jun 08 18:11:50.914068 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.914030 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:11:50.966895 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:50.966864 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf"] Jun 08 18:11:50.969998 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:11:50.969971 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f9c3f3_d6d4_4ffa_92f5_88f163256aaf.slice/crio-32b624530cb1e31448d5903a84889d9763bdeedcd364e43e88848af481935c43 WatchSource:0}: Error finding container 32b624530cb1e31448d5903a84889d9763bdeedcd364e43e88848af481935c43: Status 404 returned error can't find the container with id 32b624530cb1e31448d5903a84889d9763bdeedcd364e43e88848af481935c43 Jun 08 18:11:51.153746 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:51.153661 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf" event={"ID":"18f9c3f3-d6d4-4ffa-92f5-88f163256aaf","Type":"ContainerStarted","Data":"32b624530cb1e31448d5903a84889d9763bdeedcd364e43e88848af481935c43"} Jun 08 18:11:51.261175 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:51.261127 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7qckw\" (UID: \"76e1a31b-3e39-472f-a4ef-9d53ebc7a59a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" Jun 08 18:11:51.261359 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:51.261278 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 18:11:51.261359 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:51.261346 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls podName:76e1a31b-3e39-472f-a4ef-9d53ebc7a59a nodeName:}" failed. No retries permitted until 2026-06-08 18:11:52.261331845 +0000 UTC m=+269.357831297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7qckw" (UID: "76e1a31b-3e39-472f-a4ef-9d53ebc7a59a") : secret "cluster-monitoring-operator-tls" not found Jun 08 18:11:51.362468 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:51.362434 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mkhq\" (UID: \"c61949ce-e85f-4004-be6d-908faafb7aee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq" Jun 08 18:11:51.362686 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:51.362549 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 18:11:51.362686 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:51.362601 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert podName:c61949ce-e85f-4004-be6d-908faafb7aee nodeName:}" failed. No retries permitted until 2026-06-08 18:11:52.362587422 +0000 UTC m=+269.459086869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6mkhq" (UID: "c61949ce-e85f-4004-be6d-908faafb7aee") : secret "networking-console-plugin-cert" not found Jun 08 18:11:52.269502 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:52.269462 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7qckw\" (UID: \"76e1a31b-3e39-472f-a4ef-9d53ebc7a59a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" Jun 08 18:11:52.269944 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:52.269643 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 18:11:52.269944 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:52.269724 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls podName:76e1a31b-3e39-472f-a4ef-9d53ebc7a59a nodeName:}" failed. No retries permitted until 2026-06-08 18:11:54.269702668 +0000 UTC m=+271.366202122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7qckw" (UID: "76e1a31b-3e39-472f-a4ef-9d53ebc7a59a") : secret "cluster-monitoring-operator-tls" not found Jun 08 18:11:52.369947 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:52.369910 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mkhq\" (UID: \"c61949ce-e85f-4004-be6d-908faafb7aee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq" Jun 08 18:11:52.370138 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:52.370013 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 18:11:52.370138 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:52.370066 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert podName:c61949ce-e85f-4004-be6d-908faafb7aee nodeName:}" failed. No retries permitted until 2026-06-08 18:11:54.370053588 +0000 UTC m=+271.466553036 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6mkhq" (UID: "c61949ce-e85f-4004-be6d-908faafb7aee") : secret "networking-console-plugin-cert" not found Jun 08 18:11:53.159957 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:53.159917 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf" event={"ID":"18f9c3f3-d6d4-4ffa-92f5-88f163256aaf","Type":"ContainerStarted","Data":"d8ce237c67a748e5ffe8ac6075240c4d5bcb80123e0b5cad3970ace458b2b4f7"} Jun 08 18:11:53.176459 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:53.176415 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf" podStartSLOduration=1.2111089879999999 podStartE2EDuration="3.176401329s" totalImagesPullingTime="1.965292341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:11:53.175896177 +0000 UTC m=+270.272395648" watchObservedRunningTime="2026-06-08 18:11:53.176401329 +0000 UTC m=+270.272900795" Jun 08 18:11:54.288075 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:54.288024 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7qckw\" (UID: \"76e1a31b-3e39-472f-a4ef-9d53ebc7a59a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" Jun 08 18:11:54.288480 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:54.288152 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 18:11:54.288480 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:54.288205 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls podName:76e1a31b-3e39-472f-a4ef-9d53ebc7a59a nodeName:}" failed. No retries permitted until 2026-06-08 18:11:58.288191907 +0000 UTC m=+275.384691355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7qckw" (UID: "76e1a31b-3e39-472f-a4ef-9d53ebc7a59a") : secret "cluster-monitoring-operator-tls" not found Jun 08 18:11:54.388516 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:54.388479 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mkhq\" (UID: \"c61949ce-e85f-4004-be6d-908faafb7aee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq" Jun 08 18:11:54.388671 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:54.388639 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 18:11:54.388732 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:54.388718 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert podName:c61949ce-e85f-4004-be6d-908faafb7aee nodeName:}" failed. No retries permitted until 2026-06-08 18:11:58.388697994 +0000 UTC m=+275.485197464 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6mkhq" (UID: "c61949ce-e85f-4004-be6d-908faafb7aee") : secret "networking-console-plugin-cert" not found Jun 08 18:11:54.584244 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:54.584165 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:11:54.853495 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:54.853407 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:11:54.953643 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:54.953601 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:11:55.013208 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:55.013173 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:11:55.421663 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:55.421628 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:11:55.493506 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:55.493467 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:11:55.633722 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:55.633689 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:11:55.705613 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:55.705528 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:11:56.588393 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:56.588363 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9fxrg_19721b88-ef0f-45e3-bbb2-5617aaeee3b5/dns-node-resolver/0.log" Jun 08 18:11:57.267569 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.267537 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-h7t47"] Jun 08 18:11:57.270515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.270500 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-h7t47" Jun 08 18:11:57.273345 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.273323 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 08 18:11:57.273491 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.273326 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-m4qt4\"" Jun 08 18:11:57.274291 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.274275 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 08 18:11:57.274368 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.274296 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 08 18:11:57.274368 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.274296 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 08 18:11:57.280606 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.280588 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-h7t47"] Jun 08 18:11:57.307434 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.307396 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:11:57.311297 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.311279 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1-signing-key\") pod \"service-ca-7d74d578b8-h7t47\" (UID: \"9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-h7t47" Jun 08 18:11:57.311367 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.311305 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1-signing-cabundle\") pod \"service-ca-7d74d578b8-h7t47\" (UID: \"9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-h7t47" Jun 08 18:11:57.311367 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.311329 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g86wl\" (UniqueName: \"kubernetes.io/projected/9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1-kube-api-access-g86wl\") pod \"service-ca-7d74d578b8-h7t47\" (UID: \"9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-h7t47" Jun 08 18:11:57.371328 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.371299 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:11:57.412005 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.411981 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1-signing-key\") pod \"service-ca-7d74d578b8-h7t47\" (UID: \"9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-h7t47" Jun 08 18:11:57.412005 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.412006 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1-signing-cabundle\") pod \"service-ca-7d74d578b8-h7t47\" (UID: \"9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-h7t47" Jun 08 18:11:57.412195 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.412030 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g86wl\" (UniqueName: \"kubernetes.io/projected/9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1-kube-api-access-g86wl\") pod \"service-ca-7d74d578b8-h7t47\" (UID: \"9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-h7t47" Jun 08 18:11:57.413496 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.413474 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1-signing-cabundle\") pod \"service-ca-7d74d578b8-h7t47\" (UID: \"9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-h7t47" Jun 08 18:11:57.414548 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.414528 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1-signing-key\") pod \"service-ca-7d74d578b8-h7t47\" (UID: \"9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-h7t47" Jun 08 18:11:57.420079 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.420056 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g86wl\" (UniqueName: \"kubernetes.io/projected/9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1-kube-api-access-g86wl\") pod \"service-ca-7d74d578b8-h7t47\" (UID: \"9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1\") " pod="openshift-service-ca/service-ca-7d74d578b8-h7t47" Jun 08 18:11:57.580002 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.579909 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-h7t47" Jun 08 18:11:57.590186 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.590162 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-68pd6_33e0074d-ecf4-4562-892c-c1a812e17ea2/node-ca/0.log" Jun 08 18:11:57.706477 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:57.706445 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-h7t47"] Jun 08 18:11:57.710534 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:11:57.710499 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4bcaa7_77ee_4e6e_b7c0_40fefdc705c1.slice/crio-8efe8a3ade559ae72163019597fe57bf2bcff3e00fea5be3694a0dc7dc5417ac WatchSource:0}: Error finding container 8efe8a3ade559ae72163019597fe57bf2bcff3e00fea5be3694a0dc7dc5417ac: Status 404 returned error can't find the container with id 8efe8a3ade559ae72163019597fe57bf2bcff3e00fea5be3694a0dc7dc5417ac Jun 08 18:11:58.162492 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:58.162448 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:11:58.173349 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:58.173315 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-h7t47" event={"ID":"9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1","Type":"ContainerStarted","Data":"8efe8a3ade559ae72163019597fe57bf2bcff3e00fea5be3694a0dc7dc5417ac"} Jun 08 18:11:58.318736 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:58.318699 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7qckw\" (UID: \"76e1a31b-3e39-472f-a4ef-9d53ebc7a59a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" Jun 08 18:11:58.318906 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:58.318845 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 18:11:58.318953 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:58.318923 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls podName:76e1a31b-3e39-472f-a4ef-9d53ebc7a59a nodeName:}" failed. No retries permitted until 2026-06-08 18:12:06.318908398 +0000 UTC m=+283.415407847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7qckw" (UID: "76e1a31b-3e39-472f-a4ef-9d53ebc7a59a") : secret "cluster-monitoring-operator-tls" not found Jun 08 18:11:58.419650 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:58.419551 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mkhq\" (UID: \"c61949ce-e85f-4004-be6d-908faafb7aee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq" Jun 08 18:11:58.419796 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:58.419730 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 18:11:58.419851 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:11:58.419812 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert podName:c61949ce-e85f-4004-be6d-908faafb7aee nodeName:}" failed. No retries permitted until 2026-06-08 18:12:06.419790071 +0000 UTC m=+283.516289521 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6mkhq" (UID: "c61949ce-e85f-4004-be6d-908faafb7aee") : secret "networking-console-plugin-cert" not found Jun 08 18:11:58.785636 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:11:58.785606 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t7hm6_0de14d23-338d-40ba-a6c5-99db292ddb6d/serve-healthcheck-canary/0.log" Jun 08 18:12:00.462218 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:00.462187 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:01.184591 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:01.184556 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-h7t47" event={"ID":"9c4bcaa7-77ee-4e6e-b7c0-40fefdc705c1","Type":"ContainerStarted","Data":"43c5e99e47bd63edc69c2e3ce24871648aa9847eab2aa384dbe19091a610ac66"} Jun 08 18:12:01.203317 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:01.203267 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-h7t47" podStartSLOduration=1.674095487 podStartE2EDuration="4.203250653s" totalImagesPullingTime="2.529155166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:11:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:01.202046066 +0000 UTC m=+278.298545537" watchObservedRunningTime="2026-06-08 18:12:01.203250653 +0000 UTC m=+278.299750123" Jun 08 18:12:01.467826 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:01.467792 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:01.569930 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:01.569895 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:01.745897 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:01.745791 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:01.803519 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:01.803480 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:01.895802 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:01.895766 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:02.171532 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:02.171438 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:03.163976 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:03.163944 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:03.561788 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:03.561757 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:03.769488 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:03.769456 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:03.891168 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:12:03.891074 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" podUID="caba31aa-9b98-456d-94c4-2114b180472c" Jun 08 18:12:03.891168 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:12:03.891101 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-f2b89" podUID="b86ecae8-ac1d-4eb0-b49f-3b62e30cc190" Jun 08 18:12:03.960722 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:03.960684 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:04.193409 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:04.193318 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:12:04.193409 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:04.193318 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f2b89" Jun 08 18:12:04.357806 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:04.357765 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:04.756781 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:04.756744 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:04.850809 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:04.850763 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:04.960143 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:04.960104 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:05.358477 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:05.358428 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:05.459342 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:05.459303 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:05.559031 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:05.558995 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:05.959018 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:05.958984 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:06.380702 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:06.380656 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7qckw\" (UID: \"76e1a31b-3e39-472f-a4ef-9d53ebc7a59a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" Jun 08 18:12:06.381184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:06.380813 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:06.381184 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:12:06.380829 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 08 18:12:06.381184 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:12:06.380903 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls podName:76e1a31b-3e39-472f-a4ef-9d53ebc7a59a nodeName:}" failed. No retries permitted until 2026-06-08 18:12:22.380889034 +0000 UTC m=+299.477388481 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7qckw" (UID: "76e1a31b-3e39-472f-a4ef-9d53ebc7a59a") : secret "cluster-monitoring-operator-tls" not found Jun 08 18:12:06.481478 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:06.481439 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mkhq\" (UID: \"c61949ce-e85f-4004-be6d-908faafb7aee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq" Jun 08 18:12:06.481683 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:12:06.481611 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 08 18:12:06.481751 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:12:06.481689 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert podName:c61949ce-e85f-4004-be6d-908faafb7aee nodeName:}" failed. No retries permitted until 2026-06-08 18:12:22.48166925 +0000 UTC m=+299.578168698 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-6mkhq" (UID: "c61949ce-e85f-4004-be6d-908faafb7aee") : secret "networking-console-plugin-cert" not found Jun 08 18:12:07.161480 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:07.161442 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:07.357616 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:07.357578 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:07.559532 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:07.559503 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:07.660147 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:07.660114 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:07.766690 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:07.766653 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:07.791721 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:07.791678 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:12:07.791861 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:07.791750 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:12:07.794279 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:07.794252 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls\") pod \"image-registry-6ddd65fc66-sln2l\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:12:07.794279 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:07.794274 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b86ecae8-ac1d-4eb0-b49f-3b62e30cc190-metrics-tls\") pod \"dns-default-f2b89\" (UID: \"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190\") " pod="openshift-dns/dns-default-f2b89" Jun 08 18:12:07.861498 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:07.861408 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:08.098357 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:08.098326 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9t8ln\"" Jun 08 18:12:08.098357 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:08.098352 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c8ltj\"" Jun 08 18:12:08.105426 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:08.105395 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:12:08.105591 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:08.105518 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f2b89" Jun 08 18:12:08.254754 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:08.254719 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ddd65fc66-sln2l"] Jun 08 18:12:08.258335 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:12:08.258310 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaba31aa_9b98_456d_94c4_2114b180472c.slice/crio-b8d4750a2091e20a199f276f3b1c93563029ae29e5c61596690b02c8c0d435eb WatchSource:0}: Error finding container b8d4750a2091e20a199f276f3b1c93563029ae29e5c61596690b02c8c0d435eb: Status 404 returned error can't find the container with id b8d4750a2091e20a199f276f3b1c93563029ae29e5c61596690b02c8c0d435eb Jun 08 18:12:08.271432 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:08.269363 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f2b89"] Jun 08 18:12:08.275445 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:12:08.275411 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb86ecae8_ac1d_4eb0_b49f_3b62e30cc190.slice/crio-dabcf6c65f568368d7c5ec22dc1d5b015952563dbcf37b6d808eb901d2ea76df WatchSource:0}: Error finding container dabcf6c65f568368d7c5ec22dc1d5b015952563dbcf37b6d808eb901d2ea76df: Status 404 returned error can't find the container with id dabcf6c65f568368d7c5ec22dc1d5b015952563dbcf37b6d808eb901d2ea76df Jun 08 18:12:08.757033 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:08.756998 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:08.967597 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:08.967560 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:09.210588 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:09.210496 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f2b89" event={"ID":"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190","Type":"ContainerStarted","Data":"dabcf6c65f568368d7c5ec22dc1d5b015952563dbcf37b6d808eb901d2ea76df"} Jun 08 18:12:09.211876 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:09.211853 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" event={"ID":"caba31aa-9b98-456d-94c4-2114b180472c","Type":"ContainerStarted","Data":"3361ee095971f8b8602feab30804ea7e4d88bc2e1c549fc54721b39dc4c5820d"} Jun 08 18:12:09.211992 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:09.211892 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" event={"ID":"caba31aa-9b98-456d-94c4-2114b180472c","Type":"ContainerStarted","Data":"b8d4750a2091e20a199f276f3b1c93563029ae29e5c61596690b02c8c0d435eb"} Jun 08 18:12:09.212032 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:09.211988 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:12:09.232346 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:09.232299 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" podStartSLOduration=286.232286281 podStartE2EDuration="4m46.232286281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:07:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:09.231388817 +0000 UTC m=+286.327888278" watchObservedRunningTime="2026-06-08 18:12:09.232286281 +0000 UTC m=+286.328785750" Jun 08 18:12:09.358851 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:09.358751 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:09.549582 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:09.549532 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:09.959305 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:09.959204 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:10.364745 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:10.364655 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:10.755949 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:10.755920 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:11.220495 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:11.220462 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f2b89" event={"ID":"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190","Type":"ContainerStarted","Data":"7a86a379b28a4cd473e4a50f39283ea5f61ec69362a371cbee21c22a8bb18025"} Jun 08 18:12:11.220893 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:11.220519 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f2b89" event={"ID":"b86ecae8-ac1d-4eb0-b49f-3b62e30cc190","Type":"ContainerStarted","Data":"d650670efddf7a9c1243ee6d2d6ed612993698a752c0bf56fb67b657e0a81521"} Jun 08 18:12:11.220893 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:11.220559 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f2b89" Jun 08 18:12:11.238315 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:11.238255 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f2b89" podStartSLOduration=251.907609175 podStartE2EDuration="4m14.23823296s" totalImagesPullingTime="2.330623785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:07:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:11.237192822 +0000 UTC m=+288.333692291" watchObservedRunningTime="2026-06-08 18:12:11.23823296 +0000 UTC m=+288.334732431" Jun 08 18:12:11.364278 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:11.364233 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:11.759535 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:11.759500 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:11.956663 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:11.956626 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:12.157270 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:12.157172 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:14.426088 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:14.426052 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:14.487476 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:14.487444 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:15.974881 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:15.974852 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sr92g"] Jun 08 18:12:15.979878 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:15.979852 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sr92g" Jun 08 18:12:15.983429 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:15.983402 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bsr9b\"" Jun 08 18:12:15.983429 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:15.983426 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 18:12:15.983613 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:15.983403 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 18:12:15.983613 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:15.983411 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 18:12:15.983613 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:15.983403 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 18:12:15.988286 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:15.988260 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:15.989621 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:15.989599 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sr92g"] Jun 08 18:12:16.056313 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.056261 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:16.059190 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.059168 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0ccd296-0440-4035-824b-a99b3499101d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sr92g\" (UID: \"d0ccd296-0440-4035-824b-a99b3499101d\") " pod="openshift-insights/insights-runtime-extractor-sr92g" Jun 08 18:12:16.059267 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.059222 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d0ccd296-0440-4035-824b-a99b3499101d-crio-socket\") pod \"insights-runtime-extractor-sr92g\" (UID: \"d0ccd296-0440-4035-824b-a99b3499101d\") " pod="openshift-insights/insights-runtime-extractor-sr92g" Jun 08 18:12:16.059267 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.059246 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0ccd296-0440-4035-824b-a99b3499101d-data-volume\") pod \"insights-runtime-extractor-sr92g\" (UID: \"d0ccd296-0440-4035-824b-a99b3499101d\") " pod="openshift-insights/insights-runtime-extractor-sr92g" Jun 08 18:12:16.059363 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.059310 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0ccd296-0440-4035-824b-a99b3499101d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sr92g\" (UID: \"d0ccd296-0440-4035-824b-a99b3499101d\") " pod="openshift-insights/insights-runtime-extractor-sr92g" Jun 08 18:12:16.059442 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.059425 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxtzr\" (UniqueName: \"kubernetes.io/projected/d0ccd296-0440-4035-824b-a99b3499101d-kube-api-access-fxtzr\") pod \"insights-runtime-extractor-sr92g\" (UID: \"d0ccd296-0440-4035-824b-a99b3499101d\") " pod="openshift-insights/insights-runtime-extractor-sr92g" Jun 08 18:12:16.160752 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.160716 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d0ccd296-0440-4035-824b-a99b3499101d-crio-socket\") pod \"insights-runtime-extractor-sr92g\" (UID: \"d0ccd296-0440-4035-824b-a99b3499101d\") " pod="openshift-insights/insights-runtime-extractor-sr92g" Jun 08 18:12:16.160752 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.160752 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0ccd296-0440-4035-824b-a99b3499101d-data-volume\") pod \"insights-runtime-extractor-sr92g\" (UID: \"d0ccd296-0440-4035-824b-a99b3499101d\") " pod="openshift-insights/insights-runtime-extractor-sr92g" Jun 08 18:12:16.161010 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.160774 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0ccd296-0440-4035-824b-a99b3499101d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sr92g\" (UID: \"d0ccd296-0440-4035-824b-a99b3499101d\") " pod="openshift-insights/insights-runtime-extractor-sr92g" Jun 08 18:12:16.161010 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.160809 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxtzr\" (UniqueName: \"kubernetes.io/projected/d0ccd296-0440-4035-824b-a99b3499101d-kube-api-access-fxtzr\") pod \"insights-runtime-extractor-sr92g\" (UID: \"d0ccd296-0440-4035-824b-a99b3499101d\") " pod="openshift-insights/insights-runtime-extractor-sr92g" Jun 08 18:12:16.161010 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.160841 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d0ccd296-0440-4035-824b-a99b3499101d-crio-socket\") pod \"insights-runtime-extractor-sr92g\" (UID: \"d0ccd296-0440-4035-824b-a99b3499101d\") " pod="openshift-insights/insights-runtime-extractor-sr92g" Jun 08 18:12:16.161010 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.160854 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0ccd296-0440-4035-824b-a99b3499101d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sr92g\" (UID: \"d0ccd296-0440-4035-824b-a99b3499101d\") " pod="openshift-insights/insights-runtime-extractor-sr92g" Jun 08 18:12:16.161225 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.161160 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0ccd296-0440-4035-824b-a99b3499101d-data-volume\") pod \"insights-runtime-extractor-sr92g\" (UID: \"d0ccd296-0440-4035-824b-a99b3499101d\") " pod="openshift-insights/insights-runtime-extractor-sr92g" Jun 08 18:12:16.161486 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.161460 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0ccd296-0440-4035-824b-a99b3499101d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sr92g\" (UID: \"d0ccd296-0440-4035-824b-a99b3499101d\") " pod="openshift-insights/insights-runtime-extractor-sr92g" Jun 08 18:12:16.163419 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.163399 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0ccd296-0440-4035-824b-a99b3499101d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sr92g\" (UID: \"d0ccd296-0440-4035-824b-a99b3499101d\") " pod="openshift-insights/insights-runtime-extractor-sr92g" Jun 08 18:12:16.168600 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.168573 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxtzr\" (UniqueName: \"kubernetes.io/projected/d0ccd296-0440-4035-824b-a99b3499101d-kube-api-access-fxtzr\") pod \"insights-runtime-extractor-sr92g\" (UID: \"d0ccd296-0440-4035-824b-a99b3499101d\") " pod="openshift-insights/insights-runtime-extractor-sr92g" Jun 08 18:12:16.289571 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.289478 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sr92g" Jun 08 18:12:16.418160 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:16.418130 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sr92g"] Jun 08 18:12:16.421052 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:12:16.421026 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0ccd296_0440_4035_824b_a99b3499101d.slice/crio-9df9360ced6951a771646521945f1396da781135bef22c5106629a6c13930638 WatchSource:0}: Error finding container 9df9360ced6951a771646521945f1396da781135bef22c5106629a6c13930638: Status 404 returned error can't find the container with id 9df9360ced6951a771646521945f1396da781135bef22c5106629a6c13930638 Jun 08 18:12:17.239288 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:17.239246 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sr92g" event={"ID":"d0ccd296-0440-4035-824b-a99b3499101d","Type":"ContainerStarted","Data":"99029991064daac7e3d72b76078b18c64e89a07cf52772a3d44bb397202c9240"} Jun 08 18:12:17.239689 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:17.239302 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sr92g" event={"ID":"d0ccd296-0440-4035-824b-a99b3499101d","Type":"ContainerStarted","Data":"5bf2cdff7f061b03c703bd41465a7fa61ad0fff2273dad00eb5bc2dd1724ae17"} Jun 08 18:12:17.239689 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:17.239321 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sr92g" event={"ID":"d0ccd296-0440-4035-824b-a99b3499101d","Type":"ContainerStarted","Data":"9df9360ced6951a771646521945f1396da781135bef22c5106629a6c13930638"} Jun 08 18:12:18.395011 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:12:18.394972 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-prs9q" podUID="bd32751c-d426-4826-84a7-9f90d2bdc2de" Jun 08 18:12:19.248636 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:19.248597 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sr92g" event={"ID":"d0ccd296-0440-4035-824b-a99b3499101d","Type":"ContainerStarted","Data":"c333a91fa2a9efb9ee64228053ad9404c265c2443046307db8ea162feb99359d"} Jun 08 18:12:21.226135 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:21.226105 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f2b89" Jun 08 18:12:21.244896 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:21.244840 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sr92g" podStartSLOduration=4.126998187 podStartE2EDuration="6.244823701s" totalImagesPullingTime="2.117825514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:12:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:19.266973683 +0000 UTC m=+296.363473155" watchObservedRunningTime="2026-06-08 18:12:21.244823701 +0000 UTC m=+298.341323171" Jun 08 18:12:22.411774 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:22.411718 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7qckw\" (UID: \"76e1a31b-3e39-472f-a4ef-9d53ebc7a59a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" Jun 08 18:12:22.414094 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:22.414070 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76e1a31b-3e39-472f-a4ef-9d53ebc7a59a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7qckw\" (UID: \"76e1a31b-3e39-472f-a4ef-9d53ebc7a59a\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" Jun 08 18:12:22.433015 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:22.432976 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" Jun 08 18:12:22.513007 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:22.512709 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mkhq\" (UID: \"c61949ce-e85f-4004-be6d-908faafb7aee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq" Jun 08 18:12:22.515642 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:22.515587 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c61949ce-e85f-4004-be6d-908faafb7aee-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-6mkhq\" (UID: \"c61949ce-e85f-4004-be6d-908faafb7aee\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq" Jun 08 18:12:22.527276 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:22.527243 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq" Jun 08 18:12:22.561367 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:22.561339 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw"] Jun 08 18:12:22.563754 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:12:22.563723 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e1a31b_3e39_472f_a4ef_9d53ebc7a59a.slice/crio-e34c48ad58f0130d3893eb1a5f899620588fafedd45fe6d61392a210ea1992a5 WatchSource:0}: Error finding container e34c48ad58f0130d3893eb1a5f899620588fafedd45fe6d61392a210ea1992a5: Status 404 returned error can't find the container with id e34c48ad58f0130d3893eb1a5f899620588fafedd45fe6d61392a210ea1992a5 Jun 08 18:12:22.656031 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:22.655978 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq"] Jun 08 18:12:22.658359 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:12:22.658331 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc61949ce_e85f_4004_be6d_908faafb7aee.slice/crio-287c63999563dba73caac17f7aee81d2acd915902b5fc763350ec412cb3fe945 WatchSource:0}: Error finding container 287c63999563dba73caac17f7aee81d2acd915902b5fc763350ec412cb3fe945: Status 404 returned error can't find the container with id 287c63999563dba73caac17f7aee81d2acd915902b5fc763350ec412cb3fe945 Jun 08 18:12:23.265804 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:23.265760 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq" event={"ID":"c61949ce-e85f-4004-be6d-908faafb7aee","Type":"ContainerStarted","Data":"287c63999563dba73caac17f7aee81d2acd915902b5fc763350ec412cb3fe945"} Jun 08 18:12:23.266909 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:23.266879 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" event={"ID":"76e1a31b-3e39-472f-a4ef-9d53ebc7a59a","Type":"ContainerStarted","Data":"e34c48ad58f0130d3893eb1a5f899620588fafedd45fe6d61392a210ea1992a5"} Jun 08 18:12:23.336765 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:23.336738 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb7h4_b362d30f-bd8d-4a56-ae18-f05ebf4edb01/ovn-acl-logging/0.log" Jun 08 18:12:23.336933 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:23.336799 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb7h4_b362d30f-bd8d-4a56-ae18-f05ebf4edb01/ovn-acl-logging/0.log" Jun 08 18:12:23.340490 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:23.340464 2556 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 18:12:24.682679 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:24.682601 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:24.844989 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:24.844951 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pwfjh"] Jun 08 18:12:24.848742 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:24.848717 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pwfjh" Jun 08 18:12:24.851265 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:24.851234 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 18:12:24.851394 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:24.851277 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vkrbz\"" Jun 08 18:12:24.857447 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:24.857425 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pwfjh"] Jun 08 18:12:24.933567 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:24.933476 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3c7bd69c-d2a2-422b-b3c7-e4666b1c0196-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-pwfjh\" (UID: \"3c7bd69c-d2a2-422b-b3c7-e4666b1c0196\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pwfjh" Jun 08 18:12:25.034748 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:25.034714 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3c7bd69c-d2a2-422b-b3c7-e4666b1c0196-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-pwfjh\" (UID: \"3c7bd69c-d2a2-422b-b3c7-e4666b1c0196\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pwfjh" Jun 08 18:12:25.034925 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:12:25.034900 2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 08 18:12:25.034997 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:12:25.034984 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c7bd69c-d2a2-422b-b3c7-e4666b1c0196-tls-certificates podName:3c7bd69c-d2a2-422b-b3c7-e4666b1c0196 nodeName:}" failed. No retries permitted until 2026-06-08 18:12:25.53496426 +0000 UTC m=+302.631463723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/3c7bd69c-d2a2-422b-b3c7-e4666b1c0196-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-pwfjh" (UID: "3c7bd69c-d2a2-422b-b3c7-e4666b1c0196") : secret "prometheus-operator-admission-webhook-tls" not found Jun 08 18:12:25.275788 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:25.275751 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq" event={"ID":"c61949ce-e85f-4004-be6d-908faafb7aee","Type":"ContainerStarted","Data":"430dc68b90eecf0358665f079ace11d3fc49e910681a616873d87d10aa3b6f36"} Jun 08 18:12:25.277205 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:25.277174 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" event={"ID":"76e1a31b-3e39-472f-a4ef-9d53ebc7a59a","Type":"ContainerStarted","Data":"dd910e42da57689cda56488c004267a8190f9d041f7f9a73a54341aa8aa159de"} Jun 08 18:12:25.294127 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:25.294064 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-6mkhq" podStartSLOduration=33.608553238 podStartE2EDuration="35.294042825s" totalImagesPullingTime="1.685489587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:25.294044025 +0000 UTC m=+302.390543496" watchObservedRunningTime="2026-06-08 18:12:25.294042825 +0000 UTC m=+302.390542296" Jun 08 18:12:25.539667 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:25.539562 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3c7bd69c-d2a2-422b-b3c7-e4666b1c0196-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-pwfjh\" (UID: \"3c7bd69c-d2a2-422b-b3c7-e4666b1c0196\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pwfjh" Jun 08 18:12:25.542130 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:25.542101 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3c7bd69c-d2a2-422b-b3c7-e4666b1c0196-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-pwfjh\" (UID: \"3c7bd69c-d2a2-422b-b3c7-e4666b1c0196\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pwfjh" Jun 08 18:12:25.759922 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:25.759881 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pwfjh" Jun 08 18:12:25.820748 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:25.820714 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:25.899659 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:25.899608 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7qckw" podStartSLOduration=34.114976166 podStartE2EDuration="35.899588172s" totalImagesPullingTime="1.784612006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:11:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:25.312994695 +0000 UTC m=+302.409494166" watchObservedRunningTime="2026-06-08 18:12:25.899588172 +0000 UTC m=+302.996087645" Jun 08 18:12:25.900451 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:25.900317 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pwfjh"] Jun 08 18:12:25.902958 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:12:25.902930 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7bd69c_d2a2_422b_b3c7_e4666b1c0196.slice/crio-99808d3b2e339d7ee30894df13a5815867113f0825927bbeb85f711725beaa92 WatchSource:0}: Error finding container 99808d3b2e339d7ee30894df13a5815867113f0825927bbeb85f711725beaa92: Status 404 returned error can't find the container with id 99808d3b2e339d7ee30894df13a5815867113f0825927bbeb85f711725beaa92 Jun 08 18:12:25.904896 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:25.904882 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 18:12:26.281513 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:26.281474 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pwfjh" event={"ID":"3c7bd69c-d2a2-422b-b3c7-e4666b1c0196","Type":"ContainerStarted","Data":"99808d3b2e339d7ee30894df13a5815867113f0825927bbeb85f711725beaa92"} Jun 08 18:12:27.285468 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:27.285432 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pwfjh" event={"ID":"3c7bd69c-d2a2-422b-b3c7-e4666b1c0196","Type":"ContainerStarted","Data":"fbbfe8b59e386cdda1e76af0ef940d144e5c7b8a96ac7bd8be258619f439d610"} Jun 08 18:12:27.287175 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:27.287001 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pwfjh" Jun 08 18:12:27.292205 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:27.292181 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pwfjh" Jun 08 18:12:27.302520 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:27.302474 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-pwfjh" podStartSLOduration=2.3325673 podStartE2EDuration="3.302461581s" totalImagesPullingTime="969.894281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:12:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:27.302432571 +0000 UTC m=+304.398932041" watchObservedRunningTime="2026-06-08 18:12:27.302461581 +0000 UTC m=+304.398961042" Jun 08 18:12:27.872591 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:27.872560 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:27.906929 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:27.906898 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-sdccp"] Jun 08 18:12:27.909941 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:27.909925 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" Jun 08 18:12:27.913353 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:27.913326 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 08 18:12:27.913353 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:27.913342 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zzs8f\"" Jun 08 18:12:27.913561 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:27.913414 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 18:12:27.913622 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:27.913577 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 08 18:12:27.918488 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:27.918457 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-sdccp"] Jun 08 18:12:27.941456 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:27.941431 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:28.060070 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.060034 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz2pt\" (UniqueName: \"kubernetes.io/projected/86fedcf7-5765-49b3-b49a-bda367c7f3b9-kube-api-access-rz2pt\") pod \"prometheus-operator-7f7d445d84-sdccp\" (UID: \"86fedcf7-5765-49b3-b49a-bda367c7f3b9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" Jun 08 18:12:28.060070 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.060071 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86fedcf7-5765-49b3-b49a-bda367c7f3b9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-sdccp\" (UID: \"86fedcf7-5765-49b3-b49a-bda367c7f3b9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" Jun 08 18:12:28.060277 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.060101 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86fedcf7-5765-49b3-b49a-bda367c7f3b9-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-sdccp\" (UID: \"86fedcf7-5765-49b3-b49a-bda367c7f3b9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" Jun 08 18:12:28.060277 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.060160 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/86fedcf7-5765-49b3-b49a-bda367c7f3b9-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-sdccp\" (UID: \"86fedcf7-5765-49b3-b49a-bda367c7f3b9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" Jun 08 18:12:28.110041 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.110007 2556 patch_prober.go:28] interesting pod/image-registry-6ddd65fc66-sln2l container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 18:12:28.110196 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.110057 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" podUID="caba31aa-9b98-456d-94c4-2114b180472c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 18:12:28.161602 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.161541 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86fedcf7-5765-49b3-b49a-bda367c7f3b9-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-sdccp\" (UID: \"86fedcf7-5765-49b3-b49a-bda367c7f3b9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" Jun 08 18:12:28.161602 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.161573 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/86fedcf7-5765-49b3-b49a-bda367c7f3b9-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-sdccp\" (UID: \"86fedcf7-5765-49b3-b49a-bda367c7f3b9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" Jun 08 18:12:28.161761 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.161626 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz2pt\" (UniqueName: \"kubernetes.io/projected/86fedcf7-5765-49b3-b49a-bda367c7f3b9-kube-api-access-rz2pt\") pod \"prometheus-operator-7f7d445d84-sdccp\" (UID: \"86fedcf7-5765-49b3-b49a-bda367c7f3b9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" Jun 08 18:12:28.161761 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.161643 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86fedcf7-5765-49b3-b49a-bda367c7f3b9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-sdccp\" (UID: \"86fedcf7-5765-49b3-b49a-bda367c7f3b9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" Jun 08 18:12:28.161863 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:12:28.161776 2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 08 18:12:28.161863 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:12:28.161859 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86fedcf7-5765-49b3-b49a-bda367c7f3b9-prometheus-operator-tls podName:86fedcf7-5765-49b3-b49a-bda367c7f3b9 nodeName:}" failed. No retries permitted until 2026-06-08 18:12:28.661838902 +0000 UTC m=+305.758338366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/86fedcf7-5765-49b3-b49a-bda367c7f3b9-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-sdccp" (UID: "86fedcf7-5765-49b3-b49a-bda367c7f3b9") : secret "prometheus-operator-tls" not found Jun 08 18:12:28.162290 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.162265 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86fedcf7-5765-49b3-b49a-bda367c7f3b9-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-sdccp\" (UID: \"86fedcf7-5765-49b3-b49a-bda367c7f3b9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" Jun 08 18:12:28.163960 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.163934 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86fedcf7-5765-49b3-b49a-bda367c7f3b9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-sdccp\" (UID: \"86fedcf7-5765-49b3-b49a-bda367c7f3b9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" Jun 08 18:12:28.170305 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.170284 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz2pt\" (UniqueName: \"kubernetes.io/projected/86fedcf7-5765-49b3-b49a-bda367c7f3b9-kube-api-access-rz2pt\") pod \"prometheus-operator-7f7d445d84-sdccp\" (UID: \"86fedcf7-5765-49b3-b49a-bda367c7f3b9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" Jun 08 18:12:28.383789 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.383753 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:28.666792 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.666752 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/86fedcf7-5765-49b3-b49a-bda367c7f3b9-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-sdccp\" (UID: \"86fedcf7-5765-49b3-b49a-bda367c7f3b9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" Jun 08 18:12:28.669138 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.669120 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/86fedcf7-5765-49b3-b49a-bda367c7f3b9-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-sdccp\" (UID: \"86fedcf7-5765-49b3-b49a-bda367c7f3b9\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" Jun 08 18:12:28.819792 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.819755 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" Jun 08 18:12:28.943863 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:28.943794 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-sdccp"] Jun 08 18:12:28.946852 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:12:28.946823 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86fedcf7_5765_49b3_b49a_bda367c7f3b9.slice/crio-a3790fb3659ba7a67f6ae87b76bb98933c9164003570f8fd60f02bd051c95adc WatchSource:0}: Error finding container a3790fb3659ba7a67f6ae87b76bb98933c9164003570f8fd60f02bd051c95adc: Status 404 returned error can't find the container with id a3790fb3659ba7a67f6ae87b76bb98933c9164003570f8fd60f02bd051c95adc Jun 08 18:12:29.293765 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:29.293730 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" event={"ID":"86fedcf7-5765-49b3-b49a-bda367c7f3b9","Type":"ContainerStarted","Data":"a3790fb3659ba7a67f6ae87b76bb98933c9164003570f8fd60f02bd051c95adc"} Jun 08 18:12:29.437352 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:29.437307 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:29.537873 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:29.537827 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:30.219550 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:30.219521 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:12:30.298687 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:30.298604 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" event={"ID":"86fedcf7-5765-49b3-b49a-bda367c7f3b9","Type":"ContainerStarted","Data":"2f927b71f0eeb96ec40f6aea7fa0339e79d921b15ccf9dae3abfa0ed75b4d834"} Jun 08 18:12:30.298687 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:30.298655 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" event={"ID":"86fedcf7-5765-49b3-b49a-bda367c7f3b9","Type":"ContainerStarted","Data":"32a849412fd67c00dbcf0dd87cf907250361666c8caa286c5279926099371156"} Jun 08 18:12:30.320523 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:30.320475 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-sdccp" podStartSLOduration=2.225117932 podStartE2EDuration="3.320458959s" totalImagesPullingTime="1.095341027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:12:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:30.319536647 +0000 UTC m=+307.416036117" watchObservedRunningTime="2026-06-08 18:12:30.320458959 +0000 UTC m=+307.416958421" Jun 08 18:12:30.329516 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:30.329487 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:30.417827 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:30.417793 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:30.478458 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:30.478426 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:30.535806 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:30.535765 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:30.600226 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:30.600138 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:31.393755 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:31.393722 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:12:31.623159 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:31.623121 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:31.681409 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:31.681298 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:32.000586 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.000555 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:32.213911 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.213878 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:32.238882 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.238850 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd"] Jun 08 18:12:32.242491 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.242471 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" Jun 08 18:12:32.244782 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.244753 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 08 18:12:32.244922 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.244862 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dkptx\"" Jun 08 18:12:32.245039 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.245026 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 08 18:12:32.254393 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.254359 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd"] Jun 08 18:12:32.276114 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.276084 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m7drh"] Jun 08 18:12:32.279712 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.279693 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.282361 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.282332 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 18:12:32.282712 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.282479 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m95rr\"" Jun 08 18:12:32.283279 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.283260 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 18:12:32.283646 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.283631 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 18:12:32.314910 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.314875 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:32.398776 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.398731 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9469b18-3b27-4af4-bc1e-88b7ac5b9d17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-ljzjd\" (UID: \"d9469b18-3b27-4af4-bc1e-88b7ac5b9d17\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" Jun 08 18:12:32.398963 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.398786 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/27b4f0b9-6f8a-4a49-915e-caceadda0c50-node-exporter-accelerators-collector-config\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.398963 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.398820 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9469b18-3b27-4af4-bc1e-88b7ac5b9d17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-ljzjd\" (UID: \"d9469b18-3b27-4af4-bc1e-88b7ac5b9d17\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" Jun 08 18:12:32.398963 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.398854 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/27b4f0b9-6f8a-4a49-915e-caceadda0c50-node-exporter-textfile\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.398963 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.398925 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n5sb\" (UniqueName: \"kubernetes.io/projected/27b4f0b9-6f8a-4a49-915e-caceadda0c50-kube-api-access-4n5sb\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.399168 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.398963 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9469b18-3b27-4af4-bc1e-88b7ac5b9d17-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-ljzjd\" (UID: \"d9469b18-3b27-4af4-bc1e-88b7ac5b9d17\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" Jun 08 18:12:32.399168 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.398990 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27b4f0b9-6f8a-4a49-915e-caceadda0c50-sys\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.399168 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.399011 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/27b4f0b9-6f8a-4a49-915e-caceadda0c50-root\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.399168 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.399035 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/27b4f0b9-6f8a-4a49-915e-caceadda0c50-node-exporter-wtmp\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.399168 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.399123 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27b4f0b9-6f8a-4a49-915e-caceadda0c50-metrics-client-ca\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.399372 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.399183 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtnm4\" (UniqueName: \"kubernetes.io/projected/d9469b18-3b27-4af4-bc1e-88b7ac5b9d17-kube-api-access-dtnm4\") pod \"openshift-state-metrics-65f78d5c66-ljzjd\" (UID: \"d9469b18-3b27-4af4-bc1e-88b7ac5b9d17\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" Jun 08 18:12:32.399372 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.399216 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/27b4f0b9-6f8a-4a49-915e-caceadda0c50-node-exporter-tls\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.399372 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.399239 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27b4f0b9-6f8a-4a49-915e-caceadda0c50-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.413583 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.413543 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:32.500214 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.500175 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n5sb\" (UniqueName: \"kubernetes.io/projected/27b4f0b9-6f8a-4a49-915e-caceadda0c50-kube-api-access-4n5sb\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.500421 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.500222 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9469b18-3b27-4af4-bc1e-88b7ac5b9d17-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-ljzjd\" (UID: \"d9469b18-3b27-4af4-bc1e-88b7ac5b9d17\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" Jun 08 18:12:32.500421 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.500249 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27b4f0b9-6f8a-4a49-915e-caceadda0c50-sys\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.500421 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.500269 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/27b4f0b9-6f8a-4a49-915e-caceadda0c50-root\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.500421 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.500292 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/27b4f0b9-6f8a-4a49-915e-caceadda0c50-node-exporter-wtmp\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.500421 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.500320 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27b4f0b9-6f8a-4a49-915e-caceadda0c50-metrics-client-ca\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.500421 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.500344 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/27b4f0b9-6f8a-4a49-915e-caceadda0c50-sys\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.500421 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.500366 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/27b4f0b9-6f8a-4a49-915e-caceadda0c50-root\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.500831 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.500448 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtnm4\" (UniqueName: \"kubernetes.io/projected/d9469b18-3b27-4af4-bc1e-88b7ac5b9d17-kube-api-access-dtnm4\") pod \"openshift-state-metrics-65f78d5c66-ljzjd\" (UID: \"d9469b18-3b27-4af4-bc1e-88b7ac5b9d17\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" Jun 08 18:12:32.500831 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.500466 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/27b4f0b9-6f8a-4a49-915e-caceadda0c50-node-exporter-wtmp\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.500831 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.500487 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/27b4f0b9-6f8a-4a49-915e-caceadda0c50-node-exporter-tls\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.500831 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.500510 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27b4f0b9-6f8a-4a49-915e-caceadda0c50-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.500831 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.500547 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9469b18-3b27-4af4-bc1e-88b7ac5b9d17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-ljzjd\" (UID: \"d9469b18-3b27-4af4-bc1e-88b7ac5b9d17\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" Jun 08 18:12:32.501098 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.500842 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/27b4f0b9-6f8a-4a49-915e-caceadda0c50-node-exporter-accelerators-collector-config\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.501098 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.500887 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9469b18-3b27-4af4-bc1e-88b7ac5b9d17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-ljzjd\" (UID: \"d9469b18-3b27-4af4-bc1e-88b7ac5b9d17\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" Jun 08 18:12:32.501098 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.500925 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/27b4f0b9-6f8a-4a49-915e-caceadda0c50-node-exporter-textfile\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.501098 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.500933 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/27b4f0b9-6f8a-4a49-915e-caceadda0c50-metrics-client-ca\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.501098 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.501056 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9469b18-3b27-4af4-bc1e-88b7ac5b9d17-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-ljzjd\" (UID: \"d9469b18-3b27-4af4-bc1e-88b7ac5b9d17\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" Jun 08 18:12:32.501346 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.501203 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/27b4f0b9-6f8a-4a49-915e-caceadda0c50-node-exporter-textfile\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.501503 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.501468 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/27b4f0b9-6f8a-4a49-915e-caceadda0c50-node-exporter-accelerators-collector-config\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.503333 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.503305 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9469b18-3b27-4af4-bc1e-88b7ac5b9d17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-ljzjd\" (UID: \"d9469b18-3b27-4af4-bc1e-88b7ac5b9d17\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" Jun 08 18:12:32.503498 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.503482 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/27b4f0b9-6f8a-4a49-915e-caceadda0c50-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.503498 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.503484 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/27b4f0b9-6f8a-4a49-915e-caceadda0c50-node-exporter-tls\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.503907 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.503888 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9469b18-3b27-4af4-bc1e-88b7ac5b9d17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-ljzjd\" (UID: \"d9469b18-3b27-4af4-bc1e-88b7ac5b9d17\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" Jun 08 18:12:32.508023 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.508003 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtnm4\" (UniqueName: \"kubernetes.io/projected/d9469b18-3b27-4af4-bc1e-88b7ac5b9d17-kube-api-access-dtnm4\") pod \"openshift-state-metrics-65f78d5c66-ljzjd\" (UID: \"d9469b18-3b27-4af4-bc1e-88b7ac5b9d17\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" Jun 08 18:12:32.508178 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.508158 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n5sb\" (UniqueName: \"kubernetes.io/projected/27b4f0b9-6f8a-4a49-915e-caceadda0c50-kube-api-access-4n5sb\") pod \"node-exporter-m7drh\" (UID: \"27b4f0b9-6f8a-4a49-915e-caceadda0c50\") " pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.514053 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.514018 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:32.553876 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.553853 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" Jun 08 18:12:32.590479 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.590450 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m7drh" Jun 08 18:12:32.603767 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:12:32.603736 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27b4f0b9_6f8a_4a49_915e_caceadda0c50.slice/crio-d5e15ceaf704f0e9656c16eb236de04b47131fbe2f1545ade13650aaaadc7981 WatchSource:0}: Error finding container d5e15ceaf704f0e9656c16eb236de04b47131fbe2f1545ade13650aaaadc7981: Status 404 returned error can't find the container with id d5e15ceaf704f0e9656c16eb236de04b47131fbe2f1545ade13650aaaadc7981 Jun 08 18:12:32.617410 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.617328 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:32.699344 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.699312 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd"] Jun 08 18:12:32.702315 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.702280 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:32.702668 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:12:32.702645 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9469b18_3b27_4af4_bc1e_88b7ac5b9d17.slice/crio-f90c524ddeead28fe480b629d7b825b016cb11c4b5e008718989cbec36ea4443 WatchSource:0}: Error finding container f90c524ddeead28fe480b629d7b825b016cb11c4b5e008718989cbec36ea4443: Status 404 returned error can't find the container with id f90c524ddeead28fe480b629d7b825b016cb11c4b5e008718989cbec36ea4443 Jun 08 18:12:32.777583 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.777554 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:32.884184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:32.884148 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:33.219755 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.219720 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:33.301715 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.301681 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:33.305801 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.305774 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 18:12:33.311567 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.311544 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.313944 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.313921 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 18:12:33.314146 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.314130 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 18:12:33.314296 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.314282 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 18:12:33.314898 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.314518 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m7drh" event={"ID":"27b4f0b9-6f8a-4a49-915e-caceadda0c50","Type":"ContainerStarted","Data":"d5e15ceaf704f0e9656c16eb236de04b47131fbe2f1545ade13650aaaadc7981"} Jun 08 18:12:33.314898 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.314635 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 18:12:33.314898 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.314650 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-t68f4\"" Jun 08 18:12:33.319921 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.317329 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 18:12:33.319921 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.317510 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 18:12:33.319921 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.317632 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 18:12:33.319921 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.317722 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 18:12:33.319921 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.317722 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 18:12:33.326333 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.326216 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 18:12:33.327076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.327027 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" event={"ID":"d9469b18-3b27-4af4-bc1e-88b7ac5b9d17","Type":"ContainerStarted","Data":"ae8a638f8ad3ce841f493519e29f814a94ecf86f53a4d1479a5acab7e81015c8"} Jun 08 18:12:33.327184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.327093 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" event={"ID":"d9469b18-3b27-4af4-bc1e-88b7ac5b9d17","Type":"ContainerStarted","Data":"e9f9dc337dbbfc7c02c6acf58a55a095c6721acf805c3dbf1e3d7e7bd4a7e769"} Jun 08 18:12:33.327184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.327123 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" event={"ID":"d9469b18-3b27-4af4-bc1e-88b7ac5b9d17","Type":"ContainerStarted","Data":"f90c524ddeead28fe480b629d7b825b016cb11c4b5e008718989cbec36ea4443"} Jun 08 18:12:33.407990 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.407954 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.408160 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.408002 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.408160 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.408048 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-config-volume\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.408160 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.408134 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.408347 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.408199 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.408347 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.408228 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-web-config\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.408347 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.408249 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.408347 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.408266 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-tls-assets\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.408347 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.408290 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.408347 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.408328 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-config-out\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.408766 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.408372 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.408766 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.408455 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwpmw\" (UniqueName: \"kubernetes.io/projected/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-kube-api-access-cwpmw\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.408766 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.408484 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.509966 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.509841 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.509966 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.509953 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-web-config\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.510175 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.510001 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.510175 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.510031 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-tls-assets\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.510175 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.510060 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.510175 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.510087 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-config-out\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.510175 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.510119 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.510452 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.510186 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwpmw\" (UniqueName: \"kubernetes.io/projected/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-kube-api-access-cwpmw\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.510452 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.510213 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.510452 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.510257 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.510452 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.510284 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.510688 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.510670 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.512239 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.512004 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-config-volume\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.512239 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.512065 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.512836 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.512809 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.514467 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.514446 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-config-out\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.514691 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.514667 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.515821 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.515493 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-web-config\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.516734 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.516708 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.517991 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.517943 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.518567 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.518524 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-tls-assets\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.518647 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.518582 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.518780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.518756 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.519239 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.519222 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.520544 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.520520 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-config-volume\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.523612 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.523539 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:33.525965 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.525942 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwpmw\" (UniqueName: \"kubernetes.io/projected/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-kube-api-access-cwpmw\") pod \"alertmanager-main-0\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.631492 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.631461 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:12:33.946432 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:33.946369 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 18:12:33.950836 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:12:33.950806 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061fb6f2_f729_4ba1_b4e7_2cc0e5490927.slice/crio-02d96cf298e6b15df77bb382ad1a34aab68584129de554d0a6f2e4f68a1ac0a1 WatchSource:0}: Error finding container 02d96cf298e6b15df77bb382ad1a34aab68584129de554d0a6f2e4f68a1ac0a1: Status 404 returned error can't find the container with id 02d96cf298e6b15df77bb382ad1a34aab68584129de554d0a6f2e4f68a1ac0a1 Jun 08 18:12:34.332046 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:34.332010 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"061fb6f2-f729-4ba1-b4e7-2cc0e5490927","Type":"ContainerStarted","Data":"02d96cf298e6b15df77bb382ad1a34aab68584129de554d0a6f2e4f68a1ac0a1"} Jun 08 18:12:34.333464 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:34.333441 2556 generic.go:356] "Generic (PLEG): container finished" podID="27b4f0b9-6f8a-4a49-915e-caceadda0c50" containerID="637bba3a6ad61d6952afc0805d0818a85f43d3d8a9b7ac186bda06c5f354b478" exitCode=0 Jun 08 18:12:34.333606 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:34.333509 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m7drh" event={"ID":"27b4f0b9-6f8a-4a49-915e-caceadda0c50","Type":"ContainerDied","Data":"637bba3a6ad61d6952afc0805d0818a85f43d3d8a9b7ac186bda06c5f354b478"} Jun 08 18:12:34.335450 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:34.335425 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" event={"ID":"d9469b18-3b27-4af4-bc1e-88b7ac5b9d17","Type":"ContainerStarted","Data":"2f3ade5f5583ae3dee7bc027583c0948c62ea4d01285d041ddb7f3bd27515723"} Jun 08 18:12:34.366724 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:34.366684 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-ljzjd" podStartSLOduration=1.32879412 podStartE2EDuration="2.366668188s" totalImagesPullingTime="1.037874068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:34.365596305 +0000 UTC m=+311.462095775" watchObservedRunningTime="2026-06-08 18:12:34.366668188 +0000 UTC m=+311.463167659" Jun 08 18:12:35.184447 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:35.184349 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:35.286106 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:35.286066 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:35.341715 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:35.341682 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m7drh" event={"ID":"27b4f0b9-6f8a-4a49-915e-caceadda0c50","Type":"ContainerStarted","Data":"a3cfd2a35209a41ce6434a98bf37ec1dd72ce27e908c9528678c7983107a6173"} Jun 08 18:12:35.341886 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:35.341741 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m7drh" event={"ID":"27b4f0b9-6f8a-4a49-915e-caceadda0c50","Type":"ContainerStarted","Data":"d8fd00ce2b9aa7048dae8057400e1ed335fab27e36286439592d6668b88c1dbd"} Jun 08 18:12:35.343244 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:35.343219 2556 generic.go:356] "Generic (PLEG): container finished" podID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerID="bb34dba5b9aff06c45671d74bbd29246750d496b54a8b4b872c379cbd6df16bb" exitCode=0 Jun 08 18:12:35.343362 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:35.343299 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"061fb6f2-f729-4ba1-b4e7-2cc0e5490927","Type":"ContainerDied","Data":"bb34dba5b9aff06c45671d74bbd29246750d496b54a8b4b872c379cbd6df16bb"} Jun 08 18:12:35.368532 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:35.368478 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m7drh" podStartSLOduration=2.09107746 podStartE2EDuration="3.368462076s" totalImagesPullingTime="1.205488842s" totalInitContainerRuntime="71.895774ms" isStatefulPod=true podCreationTimestamp="2026-06-08 18:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:35.366775346 +0000 UTC m=+312.463274829" watchObservedRunningTime="2026-06-08 18:12:35.368462076 +0000 UTC m=+312.464961537" Jun 08 18:12:35.378899 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:35.378869 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:35.581688 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:35.581649 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:36.273076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:36.273029 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:36.356053 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:36.355991 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:36.563583 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:36.563495 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:36.752710 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:36.752669 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:36.930531 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:36.930509 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:37.028407 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:37.028358 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:37.150481 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:37.150398 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:37.282204 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:37.282170 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:37.353739 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:37.353704 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"061fb6f2-f729-4ba1-b4e7-2cc0e5490927","Type":"ContainerStarted","Data":"05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196"} Jun 08 18:12:37.353908 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:37.353795 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"061fb6f2-f729-4ba1-b4e7-2cc0e5490927","Type":"ContainerStarted","Data":"05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923"} Jun 08 18:12:37.353908 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:37.353821 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"061fb6f2-f729-4ba1-b4e7-2cc0e5490927","Type":"ContainerStarted","Data":"2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7"} Jun 08 18:12:37.353908 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:37.353846 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"061fb6f2-f729-4ba1-b4e7-2cc0e5490927","Type":"ContainerStarted","Data":"8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc"} Jun 08 18:12:37.353908 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:37.353870 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"061fb6f2-f729-4ba1-b4e7-2cc0e5490927","Type":"ContainerStarted","Data":"f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132"} Jun 08 18:12:37.383241 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:37.383188 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:38.147889 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:38.147859 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:38.353410 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:38.353356 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:38.364286 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:38.364255 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"061fb6f2-f729-4ba1-b4e7-2cc0e5490927","Type":"ContainerStarted","Data":"de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542"} Jun 08 18:12:38.401110 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:38.401009 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.418511901 podStartE2EDuration="5.400992274s" totalImagesPullingTime="2.964986024s" totalInitContainerRuntime="17.494349ms" isStatefulPod=false podCreationTimestamp="2026-06-08 18:12:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:12:38.39877897 +0000 UTC m=+315.495278440" watchObservedRunningTime="2026-06-08 18:12:38.400992274 +0000 UTC m=+315.497491743" Jun 08 18:12:38.461114 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:38.461036 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:38.512748 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:38.512716 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ddd65fc66-sln2l"] Jun 08 18:12:38.651084 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:38.651031 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:38.752554 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:38.752515 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:38.851564 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:38.851521 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:39.164297 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:39.164209 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:39.264325 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:39.264293 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:40.694207 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:40.694169 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:40.794207 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:40.794172 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:44.427424 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:44.427395 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:44.527974 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:44.527938 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:44.629011 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:44.628980 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:44.728968 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:44.728940 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:45.355243 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:45.355203 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:45.457530 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:45.457488 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:47.950578 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:47.950544 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:52.293525 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:52.293496 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:52.411329 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:52.411285 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:52.511357 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:52.511316 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:52.640102 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:52.640012 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:54.111518 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:54.111481 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:54.162206 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:54.162175 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:57.155482 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:57.155442 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:59.427458 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:59.427421 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:12:59.525170 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:12:59.525136 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:01.359733 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:01.359688 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:01.419904 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:01.419869 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:03.535836 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.535799 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" podUID="caba31aa-9b98-456d-94c4-2114b180472c" containerName="registry" containerID="cri-o://3361ee095971f8b8602feab30804ea7e4d88bc2e1c549fc54721b39dc4c5820d" gracePeriod=30 Jun 08 18:13:03.772629 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.772602 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:13:03.850409 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.850304 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/caba31aa-9b98-456d-94c4-2114b180472c-image-registry-private-configuration\") pod \"caba31aa-9b98-456d-94c4-2114b180472c\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " Jun 08 18:13:03.850409 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.850356 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-bound-sa-token\") pod \"caba31aa-9b98-456d-94c4-2114b180472c\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " Jun 08 18:13:03.850409 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.850395 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbs7k\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-kube-api-access-dbs7k\") pod \"caba31aa-9b98-456d-94c4-2114b180472c\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " Jun 08 18:13:03.850679 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.850416 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/caba31aa-9b98-456d-94c4-2114b180472c-ca-trust-extracted\") pod \"caba31aa-9b98-456d-94c4-2114b180472c\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " Jun 08 18:13:03.850679 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.850446 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls\") pod \"caba31aa-9b98-456d-94c4-2114b180472c\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " Jun 08 18:13:03.850679 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.850475 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/caba31aa-9b98-456d-94c4-2114b180472c-registry-certificates\") pod \"caba31aa-9b98-456d-94c4-2114b180472c\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " Jun 08 18:13:03.850679 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.850496 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/caba31aa-9b98-456d-94c4-2114b180472c-installation-pull-secrets\") pod \"caba31aa-9b98-456d-94c4-2114b180472c\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " Jun 08 18:13:03.850679 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.850539 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/caba31aa-9b98-456d-94c4-2114b180472c-trusted-ca\") pod \"caba31aa-9b98-456d-94c4-2114b180472c\" (UID: \"caba31aa-9b98-456d-94c4-2114b180472c\") " Jun 08 18:13:03.851046 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.851000 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caba31aa-9b98-456d-94c4-2114b180472c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "caba31aa-9b98-456d-94c4-2114b180472c" (UID: "caba31aa-9b98-456d-94c4-2114b180472c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:13:03.851140 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.851110 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caba31aa-9b98-456d-94c4-2114b180472c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "caba31aa-9b98-456d-94c4-2114b180472c" (UID: "caba31aa-9b98-456d-94c4-2114b180472c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:13:03.852931 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.852886 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caba31aa-9b98-456d-94c4-2114b180472c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "caba31aa-9b98-456d-94c4-2114b180472c" (UID: "caba31aa-9b98-456d-94c4-2114b180472c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:13:03.853167 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.853139 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "caba31aa-9b98-456d-94c4-2114b180472c" (UID: "caba31aa-9b98-456d-94c4-2114b180472c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:13:03.853235 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.853215 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "caba31aa-9b98-456d-94c4-2114b180472c" (UID: "caba31aa-9b98-456d-94c4-2114b180472c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:13:03.853297 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.853233 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-kube-api-access-dbs7k" (OuterVolumeSpecName: "kube-api-access-dbs7k") pod "caba31aa-9b98-456d-94c4-2114b180472c" (UID: "caba31aa-9b98-456d-94c4-2114b180472c"). InnerVolumeSpecName "kube-api-access-dbs7k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:13:03.853371 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.853354 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caba31aa-9b98-456d-94c4-2114b180472c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "caba31aa-9b98-456d-94c4-2114b180472c" (UID: "caba31aa-9b98-456d-94c4-2114b180472c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:13:03.859664 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.859638 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caba31aa-9b98-456d-94c4-2114b180472c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "caba31aa-9b98-456d-94c4-2114b180472c" (UID: "caba31aa-9b98-456d-94c4-2114b180472c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:13:03.951890 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.951854 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/caba31aa-9b98-456d-94c4-2114b180472c-image-registry-private-configuration\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:03.951890 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.951884 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-bound-sa-token\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:03.951890 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.951897 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbs7k\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-kube-api-access-dbs7k\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:03.952115 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.951907 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/caba31aa-9b98-456d-94c4-2114b180472c-ca-trust-extracted\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:03.952115 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.951916 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/caba31aa-9b98-456d-94c4-2114b180472c-registry-tls\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:03.952115 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.951925 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/caba31aa-9b98-456d-94c4-2114b180472c-registry-certificates\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:03.952115 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.951934 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/caba31aa-9b98-456d-94c4-2114b180472c-installation-pull-secrets\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:03.952115 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:03.951942 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/caba31aa-9b98-456d-94c4-2114b180472c-trusted-ca\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:04.454125 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:04.454092 2556 generic.go:356] "Generic (PLEG): container finished" podID="caba31aa-9b98-456d-94c4-2114b180472c" containerID="3361ee095971f8b8602feab30804ea7e4d88bc2e1c549fc54721b39dc4c5820d" exitCode=0 Jun 08 18:13:04.454292 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:04.454133 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" Jun 08 18:13:04.454292 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:04.454172 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" event={"ID":"caba31aa-9b98-456d-94c4-2114b180472c","Type":"ContainerDied","Data":"3361ee095971f8b8602feab30804ea7e4d88bc2e1c549fc54721b39dc4c5820d"} Jun 08 18:13:04.454292 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:04.454218 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6ddd65fc66-sln2l" event={"ID":"caba31aa-9b98-456d-94c4-2114b180472c","Type":"ContainerDied","Data":"b8d4750a2091e20a199f276f3b1c93563029ae29e5c61596690b02c8c0d435eb"} Jun 08 18:13:04.454292 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:04.454237 2556 scope.go:117] "RemoveContainer" containerID="3361ee095971f8b8602feab30804ea7e4d88bc2e1c549fc54721b39dc4c5820d" Jun 08 18:13:04.462664 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:04.462650 2556 scope.go:117] "RemoveContainer" containerID="3361ee095971f8b8602feab30804ea7e4d88bc2e1c549fc54721b39dc4c5820d" Jun 08 18:13:04.462938 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:13:04.462919 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3361ee095971f8b8602feab30804ea7e4d88bc2e1c549fc54721b39dc4c5820d\": container with ID starting with 3361ee095971f8b8602feab30804ea7e4d88bc2e1c549fc54721b39dc4c5820d not found: ID does not exist" containerID="3361ee095971f8b8602feab30804ea7e4d88bc2e1c549fc54721b39dc4c5820d" Jun 08 18:13:04.462983 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:04.462945 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3361ee095971f8b8602feab30804ea7e4d88bc2e1c549fc54721b39dc4c5820d"} err="failed to get container status \"3361ee095971f8b8602feab30804ea7e4d88bc2e1c549fc54721b39dc4c5820d\": rpc error: code = NotFound desc = could not find container \"3361ee095971f8b8602feab30804ea7e4d88bc2e1c549fc54721b39dc4c5820d\": container with ID starting with 3361ee095971f8b8602feab30804ea7e4d88bc2e1c549fc54721b39dc4c5820d not found: ID does not exist" Jun 08 18:13:04.474544 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:04.474523 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ddd65fc66-sln2l"] Jun 08 18:13:04.478500 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:04.478481 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6ddd65fc66-sln2l"] Jun 08 18:13:05.371666 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:05.371630 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_061fb6f2-f729-4ba1-b4e7-2cc0e5490927/init-config-reloader/0.log" Jun 08 18:13:05.378912 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:05.378888 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_061fb6f2-f729-4ba1-b4e7-2cc0e5490927/alertmanager/0.log" Jun 08 18:13:05.398120 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:05.398093 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caba31aa-9b98-456d-94c4-2114b180472c" path="/var/lib/kubelet/pods/caba31aa-9b98-456d-94c4-2114b180472c/volumes" Jun 08 18:13:05.542799 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:05.542770 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_061fb6f2-f729-4ba1-b4e7-2cc0e5490927/config-reloader/0.log" Jun 08 18:13:05.742110 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:05.742083 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_061fb6f2-f729-4ba1-b4e7-2cc0e5490927/kube-rbac-proxy-web/0.log" Jun 08 18:13:05.941344 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:05.941308 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_061fb6f2-f729-4ba1-b4e7-2cc0e5490927/kube-rbac-proxy/0.log" Jun 08 18:13:06.142674 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:06.142592 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_061fb6f2-f729-4ba1-b4e7-2cc0e5490927/kube-rbac-proxy-metric/0.log" Jun 08 18:13:06.296063 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:06.296025 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:06.342247 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:06.342219 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_061fb6f2-f729-4ba1-b4e7-2cc0e5490927/prom-label-proxy/0.log" Jun 08 18:13:06.351344 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:06.351290 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:06.544418 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:06.544360 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-7qckw_76e1a31b-3e39-472f-a4ef-9d53ebc7a59a/cluster-monitoring-operator/0.log" Jun 08 18:13:08.341051 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:08.341024 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m7drh_27b4f0b9-6f8a-4a49-915e-caceadda0c50/init-textfile/0.log" Jun 08 18:13:08.543137 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:08.543106 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m7drh_27b4f0b9-6f8a-4a49-915e-caceadda0c50/node-exporter/0.log" Jun 08 18:13:08.744634 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:08.744610 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m7drh_27b4f0b9-6f8a-4a49-915e-caceadda0c50/kube-rbac-proxy/0.log" Jun 08 18:13:09.543881 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:09.543848 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-ljzjd_d9469b18-3b27-4af4-bc1e-88b7ac5b9d17/kube-rbac-proxy-main/0.log" Jun 08 18:13:09.742280 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:09.742252 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-ljzjd_d9469b18-3b27-4af4-bc1e-88b7ac5b9d17/kube-rbac-proxy-self/0.log" Jun 08 18:13:09.942051 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:09.941955 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-ljzjd_d9469b18-3b27-4af4-bc1e-88b7ac5b9d17/openshift-state-metrics/0.log" Jun 08 18:13:10.364588 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:10.364557 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:10.443657 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:10.443614 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:10.758472 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:10.758432 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:11.229203 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:11.229176 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:11.282719 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:11.282687 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:11.543843 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:11.543752 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-sdccp_86fedcf7-5765-49b3-b49a-bda367c7f3b9/prometheus-operator/0.log" Jun 08 18:13:11.741612 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:11.741585 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-sdccp_86fedcf7-5765-49b3-b49a-bda367c7f3b9/kube-rbac-proxy/0.log" Jun 08 18:13:11.941958 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:11.941879 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-pwfjh_3c7bd69c-d2a2-422b-b3c7-e4666b1c0196/prometheus-operator-admission-webhook/0.log" Jun 08 18:13:13.942300 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:13.942197 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-6mkhq_c61949ce-e85f-4004-be6d-908faafb7aee/networking-console-plugin/0.log" Jun 08 18:13:14.427611 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:14.427581 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:14.485605 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:14.485572 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:24.529326 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:24.529295 2556 generic.go:356] "Generic (PLEG): container finished" podID="18f9c3f3-d6d4-4ffa-92f5-88f163256aaf" containerID="d8ce237c67a748e5ffe8ac6075240c4d5bcb80123e0b5cad3970ace458b2b4f7" exitCode=0 Jun 08 18:13:24.529714 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:24.529346 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf" event={"ID":"18f9c3f3-d6d4-4ffa-92f5-88f163256aaf","Type":"ContainerDied","Data":"d8ce237c67a748e5ffe8ac6075240c4d5bcb80123e0b5cad3970ace458b2b4f7"} Jun 08 18:13:24.529714 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:24.529639 2556 scope.go:117] "RemoveContainer" containerID="d8ce237c67a748e5ffe8ac6075240c4d5bcb80123e0b5cad3970ace458b2b4f7" Jun 08 18:13:25.534501 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:25.534469 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-f7zlf" event={"ID":"18f9c3f3-d6d4-4ffa-92f5-88f163256aaf","Type":"ContainerStarted","Data":"e3c78c4bc940e328144d74538225055a8b2db2d9587defc3641857c8c57b4aa2"} Jun 08 18:13:29.430298 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:29.430266 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:29.531350 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:29.531315 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:37.428121 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:37.428077 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs\") pod \"network-metrics-daemon-prs9q\" (UID: \"bd32751c-d426-4826-84a7-9f90d2bdc2de\") " pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:13:37.430545 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:37.430517 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bd32751c-d426-4826-84a7-9f90d2bdc2de-metrics-certs\") pod \"network-metrics-daemon-prs9q\" (UID: \"bd32751c-d426-4826-84a7-9f90d2bdc2de\") " pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:13:37.697554 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:37.697470 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cgshm\"" Jun 08 18:13:37.705632 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:37.705604 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-prs9q" Jun 08 18:13:37.837253 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:37.837072 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-prs9q"] Jun 08 18:13:37.839960 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:13:37.839926 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd32751c_d426_4826_84a7_9f90d2bdc2de.slice/crio-1b8b1dd1afd31eee7de4637375476012d20806779f0db915ce7d49d264458678 WatchSource:0}: Error finding container 1b8b1dd1afd31eee7de4637375476012d20806779f0db915ce7d49d264458678: Status 404 returned error can't find the container with id 1b8b1dd1afd31eee7de4637375476012d20806779f0db915ce7d49d264458678 Jun 08 18:13:38.578324 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:38.578282 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-prs9q" event={"ID":"bd32751c-d426-4826-84a7-9f90d2bdc2de","Type":"ContainerStarted","Data":"1b8b1dd1afd31eee7de4637375476012d20806779f0db915ce7d49d264458678"} Jun 08 18:13:39.583956 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:39.583920 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-prs9q" event={"ID":"bd32751c-d426-4826-84a7-9f90d2bdc2de","Type":"ContainerStarted","Data":"f44ed9d922d95a214e94d52691fcfe0db034bff619ece6d7e731b50ed01ddb63"} Jun 08 18:13:39.584450 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:39.583996 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-prs9q" event={"ID":"bd32751c-d426-4826-84a7-9f90d2bdc2de","Type":"ContainerStarted","Data":"d7c875a8d755b9a72cc784e3c90bceebcd99b5000cdb74ce42a09f283c6c4b83"} Jun 08 18:13:39.600725 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:39.600669 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-prs9q" podStartSLOduration=375.685129546 podStartE2EDuration="6m16.600651282s" totalImagesPullingTime="915.521736ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:13:39.600282785 +0000 UTC m=+376.696782267" watchObservedRunningTime="2026-06-08 18:13:39.600651282 +0000 UTC m=+376.697150753" Jun 08 18:13:39.696800 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:39.696763 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:39.762680 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:39.762644 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:48.331410 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:48.331359 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:48.384142 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:48.384099 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:52.561316 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:52.561280 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 18:13:52.561829 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:52.561580 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="alertmanager" containerID="cri-o://f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132" gracePeriod=120 Jun 08 18:13:52.561829 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:52.561651 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="kube-rbac-proxy-web" containerID="cri-o://2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7" gracePeriod=120 Jun 08 18:13:52.561829 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:52.561651 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="kube-rbac-proxy-metric" containerID="cri-o://05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196" gracePeriod=120 Jun 08 18:13:52.561829 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:52.561673 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="kube-rbac-proxy" containerID="cri-o://05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923" gracePeriod=120 Jun 08 18:13:52.561829 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:52.561736 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="config-reloader" containerID="cri-o://8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc" gracePeriod=120 Jun 08 18:13:52.562079 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:52.561915 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="prom-label-proxy" containerID="cri-o://de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542" gracePeriod=120 Jun 08 18:13:52.960749 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:52.960660 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:53.014466 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.014428 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:53.635509 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.635478 2556 generic.go:356] "Generic (PLEG): container finished" podID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerID="de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542" exitCode=0 Jun 08 18:13:53.635509 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.635503 2556 generic.go:356] "Generic (PLEG): container finished" podID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerID="05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923" exitCode=0 Jun 08 18:13:53.635509 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.635509 2556 generic.go:356] "Generic (PLEG): container finished" podID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerID="8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc" exitCode=0 Jun 08 18:13:53.635509 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.635514 2556 generic.go:356] "Generic (PLEG): container finished" podID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerID="f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132" exitCode=0 Jun 08 18:13:53.636157 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.635563 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"061fb6f2-f729-4ba1-b4e7-2cc0e5490927","Type":"ContainerDied","Data":"de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542"} Jun 08 18:13:53.636157 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.635645 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"061fb6f2-f729-4ba1-b4e7-2cc0e5490927","Type":"ContainerDied","Data":"05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923"} Jun 08 18:13:53.636157 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.635692 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"061fb6f2-f729-4ba1-b4e7-2cc0e5490927","Type":"ContainerDied","Data":"8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc"} Jun 08 18:13:53.636157 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.635733 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"061fb6f2-f729-4ba1-b4e7-2cc0e5490927","Type":"ContainerDied","Data":"f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132"} Jun 08 18:13:53.808781 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.808755 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:53.836596 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.836565 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-cluster-tls-config\") pod \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " Jun 08 18:13:53.836772 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.836630 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-config-out\") pod \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " Jun 08 18:13:53.836772 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.836667 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-config-volume\") pod \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " Jun 08 18:13:53.836772 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.836689 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-alertmanager-main-db\") pod \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " Jun 08 18:13:53.836772 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.836732 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy-web\") pod \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " Jun 08 18:13:53.836772 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.836767 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwpmw\" (UniqueName: \"kubernetes.io/projected/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-kube-api-access-cwpmw\") pod \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " Jun 08 18:13:53.837030 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.836797 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-metrics-client-ca\") pod \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " Jun 08 18:13:53.837030 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.836878 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-web-config\") pod \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " Jun 08 18:13:53.837030 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.836911 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-tls-assets\") pod \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " Jun 08 18:13:53.837030 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.836944 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-alertmanager-trusted-ca-bundle\") pod \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " Jun 08 18:13:53.837030 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.836969 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy-metric\") pod \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " Jun 08 18:13:53.837030 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.836998 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy\") pod \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " Jun 08 18:13:53.837030 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.837028 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-main-tls\") pod \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\" (UID: \"061fb6f2-f729-4ba1-b4e7-2cc0e5490927\") " Jun 08 18:13:53.837344 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.837220 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "061fb6f2-f729-4ba1-b4e7-2cc0e5490927" (UID: "061fb6f2-f729-4ba1-b4e7-2cc0e5490927"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:13:53.838712 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.838584 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "061fb6f2-f729-4ba1-b4e7-2cc0e5490927" (UID: "061fb6f2-f729-4ba1-b4e7-2cc0e5490927"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:13:53.839083 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.838927 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "061fb6f2-f729-4ba1-b4e7-2cc0e5490927" (UID: "061fb6f2-f729-4ba1-b4e7-2cc0e5490927"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 18:13:53.843534 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.843491 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-config-volume" (OuterVolumeSpecName: "config-volume") pod "061fb6f2-f729-4ba1-b4e7-2cc0e5490927" (UID: "061fb6f2-f729-4ba1-b4e7-2cc0e5490927"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:13:53.843723 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.843688 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-kube-api-access-cwpmw" (OuterVolumeSpecName: "kube-api-access-cwpmw") pod "061fb6f2-f729-4ba1-b4e7-2cc0e5490927" (UID: "061fb6f2-f729-4ba1-b4e7-2cc0e5490927"). InnerVolumeSpecName "kube-api-access-cwpmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:13:53.843838 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.843814 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "061fb6f2-f729-4ba1-b4e7-2cc0e5490927" (UID: "061fb6f2-f729-4ba1-b4e7-2cc0e5490927"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:13:53.843891 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.843832 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "061fb6f2-f729-4ba1-b4e7-2cc0e5490927" (UID: "061fb6f2-f729-4ba1-b4e7-2cc0e5490927"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:13:53.845468 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.845355 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "061fb6f2-f729-4ba1-b4e7-2cc0e5490927" (UID: "061fb6f2-f729-4ba1-b4e7-2cc0e5490927"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:13:53.846037 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.845947 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "061fb6f2-f729-4ba1-b4e7-2cc0e5490927" (UID: "061fb6f2-f729-4ba1-b4e7-2cc0e5490927"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:13:53.846105 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.846047 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "061fb6f2-f729-4ba1-b4e7-2cc0e5490927" (UID: "061fb6f2-f729-4ba1-b4e7-2cc0e5490927"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:13:53.846442 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.846369 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "061fb6f2-f729-4ba1-b4e7-2cc0e5490927" (UID: "061fb6f2-f729-4ba1-b4e7-2cc0e5490927"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:13:53.846515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.846481 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-config-out" (OuterVolumeSpecName: "config-out") pod "061fb6f2-f729-4ba1-b4e7-2cc0e5490927" (UID: "061fb6f2-f729-4ba1-b4e7-2cc0e5490927"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:13:53.858056 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.858028 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-web-config" (OuterVolumeSpecName: "web-config") pod "061fb6f2-f729-4ba1-b4e7-2cc0e5490927" (UID: "061fb6f2-f729-4ba1-b4e7-2cc0e5490927"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:13:53.937777 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.937680 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:53.937777 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.937714 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:53.937777 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.937728 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:53.937777 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.937741 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-main-tls\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:53.937777 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.937753 2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-cluster-tls-config\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:53.937777 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.937765 2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-config-out\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:53.937777 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.937778 2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-config-volume\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:53.938127 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.937789 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-alertmanager-main-db\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:53.938127 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.937802 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:53.938127 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.937815 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwpmw\" (UniqueName: \"kubernetes.io/projected/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-kube-api-access-cwpmw\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:53.938127 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.937826 2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-metrics-client-ca\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:53.938127 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.937859 2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-web-config\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:53.938127 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:53.937872 2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/061fb6f2-f729-4ba1-b4e7-2cc0e5490927-tls-assets\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:13:54.642356 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.642321 2556 generic.go:356] "Generic (PLEG): container finished" podID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerID="05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196" exitCode=0 Jun 08 18:13:54.642356 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.642348 2556 generic.go:356] "Generic (PLEG): container finished" podID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerID="2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7" exitCode=0 Jun 08 18:13:54.642812 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.642400 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.642812 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.642399 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"061fb6f2-f729-4ba1-b4e7-2cc0e5490927","Type":"ContainerDied","Data":"05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196"} Jun 08 18:13:54.642812 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.642466 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"061fb6f2-f729-4ba1-b4e7-2cc0e5490927","Type":"ContainerDied","Data":"2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7"} Jun 08 18:13:54.642812 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.642494 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"061fb6f2-f729-4ba1-b4e7-2cc0e5490927","Type":"ContainerDied","Data":"02d96cf298e6b15df77bb382ad1a34aab68584129de554d0a6f2e4f68a1ac0a1"} Jun 08 18:13:54.642812 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.642525 2556 scope.go:117] "RemoveContainer" containerID="de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542" Jun 08 18:13:54.651849 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.651821 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:13:54.659967 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.659949 2556 scope.go:117] "RemoveContainer" containerID="05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196" Jun 08 18:13:54.666653 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.666635 2556 scope.go:117] "RemoveContainer" containerID="05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923" Jun 08 18:13:54.673809 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.673790 2556 scope.go:117] "RemoveContainer" containerID="2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7" Jun 08 18:13:54.676425 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.676404 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 18:13:54.681198 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.681058 2556 scope.go:117] "RemoveContainer" containerID="8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc" Jun 08 18:13:54.681392 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.681359 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 18:13:54.687597 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.687582 2556 scope.go:117] "RemoveContainer" containerID="f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132" Jun 08 18:13:54.694058 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.694043 2556 scope.go:117] "RemoveContainer" containerID="bb34dba5b9aff06c45671d74bbd29246750d496b54a8b4b872c379cbd6df16bb" Jun 08 18:13:54.700479 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.700462 2556 scope.go:117] "RemoveContainer" containerID="de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542" Jun 08 18:13:54.700737 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:13:54.700718 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542\": container with ID starting with de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542 not found: ID does not exist" containerID="de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542" Jun 08 18:13:54.700782 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.700745 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542"} err="failed to get container status \"de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542\": rpc error: code = NotFound desc = could not find container \"de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542\": container with ID starting with de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542 not found: ID does not exist" Jun 08 18:13:54.700782 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.700762 2556 scope.go:117] "RemoveContainer" containerID="05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196" Jun 08 18:13:54.700981 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:13:54.700963 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196\": container with ID starting with 05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196 not found: ID does not exist" containerID="05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196" Jun 08 18:13:54.701019 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.700989 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196"} err="failed to get container status \"05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196\": rpc error: code = NotFound desc = could not find container \"05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196\": container with ID starting with 05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196 not found: ID does not exist" Jun 08 18:13:54.701019 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.701004 2556 scope.go:117] "RemoveContainer" containerID="05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923" Jun 08 18:13:54.701226 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:13:54.701211 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923\": container with ID starting with 05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923 not found: ID does not exist" containerID="05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923" Jun 08 18:13:54.701265 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.701229 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923"} err="failed to get container status \"05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923\": rpc error: code = NotFound desc = could not find container \"05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923\": container with ID starting with 05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923 not found: ID does not exist" Jun 08 18:13:54.701265 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.701240 2556 scope.go:117] "RemoveContainer" containerID="2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7" Jun 08 18:13:54.701442 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:13:54.701427 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7\": container with ID starting with 2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7 not found: ID does not exist" containerID="2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7" Jun 08 18:13:54.701491 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.701444 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7"} err="failed to get container status \"2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7\": rpc error: code = NotFound desc = could not find container \"2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7\": container with ID starting with 2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7 not found: ID does not exist" Jun 08 18:13:54.701491 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.701455 2556 scope.go:117] "RemoveContainer" containerID="8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc" Jun 08 18:13:54.701640 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:13:54.701625 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc\": container with ID starting with 8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc not found: ID does not exist" containerID="8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc" Jun 08 18:13:54.701676 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.701644 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc"} err="failed to get container status \"8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc\": rpc error: code = NotFound desc = could not find container \"8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc\": container with ID starting with 8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc not found: ID does not exist" Jun 08 18:13:54.701676 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.701655 2556 scope.go:117] "RemoveContainer" containerID="f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132" Jun 08 18:13:54.701849 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:13:54.701833 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132\": container with ID starting with f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132 not found: ID does not exist" containerID="f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132" Jun 08 18:13:54.701895 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.701854 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132"} err="failed to get container status \"f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132\": rpc error: code = NotFound desc = could not find container \"f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132\": container with ID starting with f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132 not found: ID does not exist" Jun 08 18:13:54.701895 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.701868 2556 scope.go:117] "RemoveContainer" containerID="bb34dba5b9aff06c45671d74bbd29246750d496b54a8b4b872c379cbd6df16bb" Jun 08 18:13:54.702048 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:13:54.702034 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb34dba5b9aff06c45671d74bbd29246750d496b54a8b4b872c379cbd6df16bb\": container with ID starting with bb34dba5b9aff06c45671d74bbd29246750d496b54a8b4b872c379cbd6df16bb not found: ID does not exist" containerID="bb34dba5b9aff06c45671d74bbd29246750d496b54a8b4b872c379cbd6df16bb" Jun 08 18:13:54.702086 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.702051 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb34dba5b9aff06c45671d74bbd29246750d496b54a8b4b872c379cbd6df16bb"} err="failed to get container status \"bb34dba5b9aff06c45671d74bbd29246750d496b54a8b4b872c379cbd6df16bb\": rpc error: code = NotFound desc = could not find container \"bb34dba5b9aff06c45671d74bbd29246750d496b54a8b4b872c379cbd6df16bb\": container with ID starting with bb34dba5b9aff06c45671d74bbd29246750d496b54a8b4b872c379cbd6df16bb not found: ID does not exist" Jun 08 18:13:54.702086 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.702062 2556 scope.go:117] "RemoveContainer" containerID="de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542" Jun 08 18:13:54.702243 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.702228 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542"} err="failed to get container status \"de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542\": rpc error: code = NotFound desc = could not find container \"de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542\": container with ID starting with de82b45b5c019a35ba8af273852dfd5f121dc28556b9615ceb15a358f99e4542 not found: ID does not exist" Jun 08 18:13:54.702323 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.702243 2556 scope.go:117] "RemoveContainer" containerID="05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196" Jun 08 18:13:54.702453 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.702436 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196"} err="failed to get container status \"05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196\": rpc error: code = NotFound desc = could not find container \"05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196\": container with ID starting with 05edf64523e4a136f34f4b759bc61bc30e48813dd247cd8ce501d5e136316196 not found: ID does not exist" Jun 08 18:13:54.702505 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.702453 2556 scope.go:117] "RemoveContainer" containerID="05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923" Jun 08 18:13:54.702662 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.702647 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923"} err="failed to get container status \"05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923\": rpc error: code = NotFound desc = could not find container \"05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923\": container with ID starting with 05c1df6b505b5b9430321810eef53980853d5f2eb6c4a4633d53c9d1b363d923 not found: ID does not exist" Jun 08 18:13:54.702704 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.702662 2556 scope.go:117] "RemoveContainer" containerID="2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7" Jun 08 18:13:54.702816 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.702802 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7"} err="failed to get container status \"2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7\": rpc error: code = NotFound desc = could not find container \"2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7\": container with ID starting with 2469d3c972b043ba8f34fc1baddf87947d28e79d34fbe2a74cc3b1949f2130e7 not found: ID does not exist" Jun 08 18:13:54.702858 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.702816 2556 scope.go:117] "RemoveContainer" containerID="8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc" Jun 08 18:13:54.702973 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.702960 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc"} err="failed to get container status \"8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc\": rpc error: code = NotFound desc = could not find container \"8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc\": container with ID starting with 8186e22995a288ae20e408eaa4f7f33ccf4b654f6ac25dfc140148381d5079fc not found: ID does not exist" Jun 08 18:13:54.703010 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.702973 2556 scope.go:117] "RemoveContainer" containerID="f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132" Jun 08 18:13:54.703153 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.703138 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132"} err="failed to get container status \"f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132\": rpc error: code = NotFound desc = could not find container \"f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132\": container with ID starting with f18ff273cf4e810695c26dff71540872c5cd0215ad94910373b527ef852bd132 not found: ID does not exist" Jun 08 18:13:54.703209 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.703152 2556 scope.go:117] "RemoveContainer" containerID="bb34dba5b9aff06c45671d74bbd29246750d496b54a8b4b872c379cbd6df16bb" Jun 08 18:13:54.703367 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.703349 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb34dba5b9aff06c45671d74bbd29246750d496b54a8b4b872c379cbd6df16bb"} err="failed to get container status \"bb34dba5b9aff06c45671d74bbd29246750d496b54a8b4b872c379cbd6df16bb\": rpc error: code = NotFound desc = could not find container \"bb34dba5b9aff06c45671d74bbd29246750d496b54a8b4b872c379cbd6df16bb\": container with ID starting with bb34dba5b9aff06c45671d74bbd29246750d496b54a8b4b872c379cbd6df16bb not found: ID does not exist" Jun 08 18:13:54.707790 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.707770 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 18:13:54.708008 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.707997 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caba31aa-9b98-456d-94c4-2114b180472c" containerName="registry" Jun 08 18:13:54.708061 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708009 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="caba31aa-9b98-456d-94c4-2114b180472c" containerName="registry" Jun 08 18:13:54.708061 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708020 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="init-config-reloader" Jun 08 18:13:54.708061 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708026 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="init-config-reloader" Jun 08 18:13:54.708061 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708037 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="kube-rbac-proxy" Jun 08 18:13:54.708061 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708044 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="kube-rbac-proxy" Jun 08 18:13:54.708061 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708050 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="kube-rbac-proxy-web" Jun 08 18:13:54.708061 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708056 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="kube-rbac-proxy-web" Jun 08 18:13:54.708061 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708062 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="config-reloader" Jun 08 18:13:54.708314 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708068 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="config-reloader" Jun 08 18:13:54.708314 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708074 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="prom-label-proxy" Jun 08 18:13:54.708314 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708079 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="prom-label-proxy" Jun 08 18:13:54.708314 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708089 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="kube-rbac-proxy-metric" Jun 08 18:13:54.708314 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708094 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="kube-rbac-proxy-metric" Jun 08 18:13:54.708314 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708102 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="alertmanager" Jun 08 18:13:54.708314 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708106 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="alertmanager" Jun 08 18:13:54.708314 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708143 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="config-reloader" Jun 08 18:13:54.708314 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708150 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="kube-rbac-proxy-web" Jun 08 18:13:54.708314 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708156 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="alertmanager" Jun 08 18:13:54.708314 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708163 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="caba31aa-9b98-456d-94c4-2114b180472c" containerName="registry" Jun 08 18:13:54.708314 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708168 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="prom-label-proxy" Jun 08 18:13:54.708314 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708174 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="kube-rbac-proxy" Jun 08 18:13:54.708314 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.708180 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" containerName="kube-rbac-proxy-metric" Jun 08 18:13:54.713153 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.713136 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.715779 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.715758 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 08 18:13:54.715863 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.715817 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 08 18:13:54.715911 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.715899 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 08 18:13:54.716005 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.715988 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 08 18:13:54.716206 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.716192 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 08 18:13:54.716266 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.716191 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 08 18:13:54.716266 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.716230 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 08 18:13:54.716344 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.716233 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-t68f4\"" Jun 08 18:13:54.716608 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.716595 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 08 18:13:54.725408 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.725194 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 08 18:13:54.727584 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.727562 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 18:13:54.743545 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.743520 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae6b7a7d-8e22-4151-87e1-c980116d1198-config-out\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.743648 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.743550 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae6b7a7d-8e22-4151-87e1-c980116d1198-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.743648 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.743568 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.743648 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.743598 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxlqk\" (UniqueName: \"kubernetes.io/projected/ae6b7a7d-8e22-4151-87e1-c980116d1198-kube-api-access-wxlqk\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.743648 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.743618 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.743648 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.743634 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-web-config\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.743852 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.743651 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae6b7a7d-8e22-4151-87e1-c980116d1198-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.743852 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.743667 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.743852 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.743683 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae6b7a7d-8e22-4151-87e1-c980116d1198-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.743852 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.743765 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae6b7a7d-8e22-4151-87e1-c980116d1198-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.743852 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.743805 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.743852 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.743831 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.744046 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.743855 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.844987 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.844944 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxlqk\" (UniqueName: \"kubernetes.io/projected/ae6b7a7d-8e22-4151-87e1-c980116d1198-kube-api-access-wxlqk\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.845183 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.844993 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.845183 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.845020 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-web-config\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.845183 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.845047 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae6b7a7d-8e22-4151-87e1-c980116d1198-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.845183 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.845071 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.845183 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.845094 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae6b7a7d-8e22-4151-87e1-c980116d1198-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.845183 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.845133 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae6b7a7d-8e22-4151-87e1-c980116d1198-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.845183 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.845157 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.845593 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.845190 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.845593 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.845223 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.845593 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.845259 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae6b7a7d-8e22-4151-87e1-c980116d1198-config-out\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.845593 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.845284 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae6b7a7d-8e22-4151-87e1-c980116d1198-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.845593 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.845309 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.845593 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.845579 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ae6b7a7d-8e22-4151-87e1-c980116d1198-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.846176 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.846111 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae6b7a7d-8e22-4151-87e1-c980116d1198-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.848433 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.848243 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ae6b7a7d-8e22-4151-87e1-c980116d1198-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.848433 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.848308 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ae6b7a7d-8e22-4151-87e1-c980116d1198-config-out\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.848433 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.848315 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-config-volume\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.848433 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.848367 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.848433 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.848423 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.848664 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.848507 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.848783 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.848759 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.848896 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.848869 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae6b7a7d-8e22-4151-87e1-c980116d1198-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.849208 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.849190 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.850151 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.850132 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ae6b7a7d-8e22-4151-87e1-c980116d1198-web-config\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:54.853009 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:54.852989 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxlqk\" (UniqueName: \"kubernetes.io/projected/ae6b7a7d-8e22-4151-87e1-c980116d1198-kube-api-access-wxlqk\") pod \"alertmanager-main-0\" (UID: \"ae6b7a7d-8e22-4151-87e1-c980116d1198\") " pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:55.024396 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:55.024343 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 08 18:13:55.158235 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:55.158211 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 08 18:13:55.160014 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:13:55.159988 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae6b7a7d_8e22_4151_87e1_c980116d1198.slice/crio-3803b06bc331b32b4e99d03b7d83744ae63a9d4d315b5b2995ab245613399f16 WatchSource:0}: Error finding container 3803b06bc331b32b4e99d03b7d83744ae63a9d4d315b5b2995ab245613399f16: Status 404 returned error can't find the container with id 3803b06bc331b32b4e99d03b7d83744ae63a9d4d315b5b2995ab245613399f16 Jun 08 18:13:55.398766 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:55.398692 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="061fb6f2-f729-4ba1-b4e7-2cc0e5490927" path="/var/lib/kubelet/pods/061fb6f2-f729-4ba1-b4e7-2cc0e5490927/volumes" Jun 08 18:13:55.648015 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:55.647979 2556 generic.go:356] "Generic (PLEG): container finished" podID="ae6b7a7d-8e22-4151-87e1-c980116d1198" containerID="3a1efd998270a6be58af12a0dcce9d66d4e96c5bc96db4cab3cd7565a67042aa" exitCode=0 Jun 08 18:13:55.648496 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:55.648071 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae6b7a7d-8e22-4151-87e1-c980116d1198","Type":"ContainerDied","Data":"3a1efd998270a6be58af12a0dcce9d66d4e96c5bc96db4cab3cd7565a67042aa"} Jun 08 18:13:55.648496 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:55.648134 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae6b7a7d-8e22-4151-87e1-c980116d1198","Type":"ContainerStarted","Data":"3803b06bc331b32b4e99d03b7d83744ae63a9d4d315b5b2995ab245613399f16"} Jun 08 18:13:56.657206 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:56.657169 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae6b7a7d-8e22-4151-87e1-c980116d1198","Type":"ContainerStarted","Data":"45c20a51d1fcb3cbe2e6d3fb88911cbbe412207bf98166557f9442541aaf3e1a"} Jun 08 18:13:56.657648 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:56.657253 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae6b7a7d-8e22-4151-87e1-c980116d1198","Type":"ContainerStarted","Data":"f842a28e2d28154222979a1d9b68fc15eed9e985284c0b96aec5cd2e0800aeda"} Jun 08 18:13:56.657648 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:56.657295 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae6b7a7d-8e22-4151-87e1-c980116d1198","Type":"ContainerStarted","Data":"ed49fc627e5965c41ce3787807130ce1fda8ce110e26b871b74642fb2750a703"} Jun 08 18:13:56.657648 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:56.657342 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae6b7a7d-8e22-4151-87e1-c980116d1198","Type":"ContainerStarted","Data":"b805349ecf9a3fe06b06814405811d7702c551f476cdc25002e21541811f90dc"} Jun 08 18:13:56.657648 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:56.657401 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae6b7a7d-8e22-4151-87e1-c980116d1198","Type":"ContainerStarted","Data":"5982417aebd669f3a525c7387cafc78a7887644e4fe8f600d10c6eccdaf5ba9e"} Jun 08 18:13:56.657648 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:56.657441 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ae6b7a7d-8e22-4151-87e1-c980116d1198","Type":"ContainerStarted","Data":"ff40d937e0b45eac0e2e645840403f4f3c3537e8a47cdabea8cbeb66f3596208"} Jun 08 18:13:56.687357 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:13:56.687295 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.671916967 podStartE2EDuration="2.687279169s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.362202ms" isStatefulPod=false podCreationTimestamp="2026-06-08 18:13:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:13:56.68511483 +0000 UTC m=+393.781614300" watchObservedRunningTime="2026-06-08 18:13:56.687279169 +0000 UTC m=+393.783778637" Jun 08 18:14:00.110086 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:00.110053 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:00.166905 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:00.166865 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:06.030274 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:06.030228 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:06.083794 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:06.083760 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:06.137690 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:06.137653 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:11.620615 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:11.620579 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:11.678049 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:11.678011 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:14.433302 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:14.433261 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:14.535637 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:14.535599 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:14.594786 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:14.594745 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:15.581900 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:15.581864 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:15.675257 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:15.675219 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:35.553342 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:35.553306 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:35.602853 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:35.602812 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:38.709789 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:38.709759 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:38.809663 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:38.809624 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:39.374987 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:39.374952 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k"] Jun 08 18:14:39.379559 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:39.379535 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" Jun 08 18:14:39.382153 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:39.382128 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 18:14:39.382284 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:39.382131 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 18:14:39.382284 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:39.382202 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nj8pv\"" Jun 08 18:14:39.388935 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:39.388909 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k"] Jun 08 18:14:39.492798 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:39.492749 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d9241e3-33dc-4716-b9fe-f473039c5613-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k\" (UID: \"5d9241e3-33dc-4716-b9fe-f473039c5613\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" Jun 08 18:14:39.492973 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:39.492819 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d9241e3-33dc-4716-b9fe-f473039c5613-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k\" (UID: \"5d9241e3-33dc-4716-b9fe-f473039c5613\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" Jun 08 18:14:39.492973 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:39.492860 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4sr8\" (UniqueName: \"kubernetes.io/projected/5d9241e3-33dc-4716-b9fe-f473039c5613-kube-api-access-h4sr8\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k\" (UID: \"5d9241e3-33dc-4716-b9fe-f473039c5613\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" Jun 08 18:14:39.594214 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:39.594176 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d9241e3-33dc-4716-b9fe-f473039c5613-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k\" (UID: \"5d9241e3-33dc-4716-b9fe-f473039c5613\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" Jun 08 18:14:39.594214 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:39.594227 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d9241e3-33dc-4716-b9fe-f473039c5613-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k\" (UID: \"5d9241e3-33dc-4716-b9fe-f473039c5613\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" Jun 08 18:14:39.594473 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:39.594251 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4sr8\" (UniqueName: \"kubernetes.io/projected/5d9241e3-33dc-4716-b9fe-f473039c5613-kube-api-access-h4sr8\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k\" (UID: \"5d9241e3-33dc-4716-b9fe-f473039c5613\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" Jun 08 18:14:39.594711 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:39.594688 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d9241e3-33dc-4716-b9fe-f473039c5613-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k\" (UID: \"5d9241e3-33dc-4716-b9fe-f473039c5613\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" Jun 08 18:14:39.594747 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:39.594696 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d9241e3-33dc-4716-b9fe-f473039c5613-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k\" (UID: \"5d9241e3-33dc-4716-b9fe-f473039c5613\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" Jun 08 18:14:39.602225 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:39.602198 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4sr8\" (UniqueName: \"kubernetes.io/projected/5d9241e3-33dc-4716-b9fe-f473039c5613-kube-api-access-h4sr8\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k\" (UID: \"5d9241e3-33dc-4716-b9fe-f473039c5613\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" Jun 08 18:14:39.688585 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:39.688501 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" Jun 08 18:14:39.816979 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:39.816914 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k"] Jun 08 18:14:39.821873 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:14:39.821842 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d9241e3_33dc_4716_b9fe_f473039c5613.slice/crio-0ae74c8a87a6f3a3d827f685b49177e84d503c0d8c9d7dfde16d68298f3c544d WatchSource:0}: Error finding container 0ae74c8a87a6f3a3d827f685b49177e84d503c0d8c9d7dfde16d68298f3c544d: Status 404 returned error can't find the container with id 0ae74c8a87a6f3a3d827f685b49177e84d503c0d8c9d7dfde16d68298f3c544d Jun 08 18:14:40.818422 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:40.818372 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" event={"ID":"5d9241e3-33dc-4716-b9fe-f473039c5613","Type":"ContainerStarted","Data":"0ae74c8a87a6f3a3d827f685b49177e84d503c0d8c9d7dfde16d68298f3c544d"} Jun 08 18:14:48.849797 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:48.849757 2556 generic.go:356] "Generic (PLEG): container finished" podID="5d9241e3-33dc-4716-b9fe-f473039c5613" containerID="1579175339fb4b642e3a1186c16ee0ec66f44b1de215255b0b51ca8a3624d27a" exitCode=0 Jun 08 18:14:48.850220 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:48.849803 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" event={"ID":"5d9241e3-33dc-4716-b9fe-f473039c5613","Type":"ContainerDied","Data":"1579175339fb4b642e3a1186c16ee0ec66f44b1de215255b0b51ca8a3624d27a"} Jun 08 18:14:50.859596 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:50.859555 2556 generic.go:356] "Generic (PLEG): container finished" podID="5d9241e3-33dc-4716-b9fe-f473039c5613" containerID="24bc2cbe77894acc9631077af1be45573ab7800ef4a53a86450800fa6759da48" exitCode=0 Jun 08 18:14:50.859596 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:50.859593 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" event={"ID":"5d9241e3-33dc-4716-b9fe-f473039c5613","Type":"ContainerDied","Data":"24bc2cbe77894acc9631077af1be45573ab7800ef4a53a86450800fa6759da48"} Jun 08 18:14:57.429201 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.429164 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2"] Jun 08 18:14:57.429751 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.429677 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:57.433685 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.433660 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2" Jun 08 18:14:57.437403 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.437257 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 08 18:14:57.437403 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.437277 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 18:14:57.437403 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.437316 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-kkhhs\"" Jun 08 18:14:57.438268 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.437416 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 18:14:57.438268 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.437578 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 18:14:57.439714 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.439689 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2"] Jun 08 18:14:57.446094 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.446062 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/888c9be8-bb70-40de-8743-d87f58d7531f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2\" (UID: \"888c9be8-bb70-40de-8743-d87f58d7531f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2" Jun 08 18:14:57.446242 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.446186 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65khv\" (UniqueName: \"kubernetes.io/projected/888c9be8-bb70-40de-8743-d87f58d7531f-kube-api-access-65khv\") pod \"managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2\" (UID: \"888c9be8-bb70-40de-8743-d87f58d7531f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2" Jun 08 18:14:57.504867 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.504827 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:57.538557 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.538522 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w"] Jun 08 18:14:57.542553 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.542525 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w" Jun 08 18:14:57.545213 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.545181 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 08 18:14:57.546722 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.546678 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdsls\" (UniqueName: \"kubernetes.io/projected/2d5d0b19-db09-4322-baba-cbece9af39b8-kube-api-access-rdsls\") pod \"klusterlet-addon-workmgr-6cbd8f549d-6457w\" (UID: \"2d5d0b19-db09-4322-baba-cbece9af39b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w" Jun 08 18:14:57.546841 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.546728 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d5d0b19-db09-4322-baba-cbece9af39b8-tmp\") pod \"klusterlet-addon-workmgr-6cbd8f549d-6457w\" (UID: \"2d5d0b19-db09-4322-baba-cbece9af39b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w" Jun 08 18:14:57.546841 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.546776 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/888c9be8-bb70-40de-8743-d87f58d7531f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2\" (UID: \"888c9be8-bb70-40de-8743-d87f58d7531f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2" Jun 08 18:14:57.546841 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.546801 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2d5d0b19-db09-4322-baba-cbece9af39b8-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cbd8f549d-6457w\" (UID: \"2d5d0b19-db09-4322-baba-cbece9af39b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w" Jun 08 18:14:57.546993 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.546873 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65khv\" (UniqueName: \"kubernetes.io/projected/888c9be8-bb70-40de-8743-d87f58d7531f-kube-api-access-65khv\") pod \"managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2\" (UID: \"888c9be8-bb70-40de-8743-d87f58d7531f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2" Jun 08 18:14:57.549617 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.549590 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/888c9be8-bb70-40de-8743-d87f58d7531f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2\" (UID: \"888c9be8-bb70-40de-8743-d87f58d7531f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2" Jun 08 18:14:57.553129 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.553104 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w"] Jun 08 18:14:57.559178 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.558969 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65khv\" (UniqueName: \"kubernetes.io/projected/888c9be8-bb70-40de-8743-d87f58d7531f-kube-api-access-65khv\") pod \"managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2\" (UID: \"888c9be8-bb70-40de-8743-d87f58d7531f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2" Jun 08 18:14:57.606575 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.606531 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:14:57.647447 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.647404 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdsls\" (UniqueName: \"kubernetes.io/projected/2d5d0b19-db09-4322-baba-cbece9af39b8-kube-api-access-rdsls\") pod \"klusterlet-addon-workmgr-6cbd8f549d-6457w\" (UID: \"2d5d0b19-db09-4322-baba-cbece9af39b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w" Jun 08 18:14:57.647447 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.647451 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d5d0b19-db09-4322-baba-cbece9af39b8-tmp\") pod \"klusterlet-addon-workmgr-6cbd8f549d-6457w\" (UID: \"2d5d0b19-db09-4322-baba-cbece9af39b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w" Jun 08 18:14:57.647705 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.647485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2d5d0b19-db09-4322-baba-cbece9af39b8-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cbd8f549d-6457w\" (UID: \"2d5d0b19-db09-4322-baba-cbece9af39b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w" Jun 08 18:14:57.647968 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.647937 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d5d0b19-db09-4322-baba-cbece9af39b8-tmp\") pod \"klusterlet-addon-workmgr-6cbd8f549d-6457w\" (UID: \"2d5d0b19-db09-4322-baba-cbece9af39b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w" Jun 08 18:14:57.650426 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.650404 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2d5d0b19-db09-4322-baba-cbece9af39b8-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cbd8f549d-6457w\" (UID: \"2d5d0b19-db09-4322-baba-cbece9af39b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w" Jun 08 18:14:57.656051 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.656023 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdsls\" (UniqueName: \"kubernetes.io/projected/2d5d0b19-db09-4322-baba-cbece9af39b8-kube-api-access-rdsls\") pod \"klusterlet-addon-workmgr-6cbd8f549d-6457w\" (UID: \"2d5d0b19-db09-4322-baba-cbece9af39b8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w" Jun 08 18:14:57.755162 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.755113 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2" Jun 08 18:14:57.870280 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:57.870239 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w" Jun 08 18:14:58.558548 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:58.558521 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2"] Jun 08 18:14:58.560965 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:14:58.560935 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod888c9be8_bb70_40de_8743_d87f58d7531f.slice/crio-6aa39c2db9d51e96bab334abf596dde51d9f4a7b03e30f9be75967437b98fcc3 WatchSource:0}: Error finding container 6aa39c2db9d51e96bab334abf596dde51d9f4a7b03e30f9be75967437b98fcc3: Status 404 returned error can't find the container with id 6aa39c2db9d51e96bab334abf596dde51d9f4a7b03e30f9be75967437b98fcc3 Jun 08 18:14:58.572419 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:58.572366 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w"] Jun 08 18:14:58.578021 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:14:58.577988 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d5d0b19_db09_4322_baba_cbece9af39b8.slice/crio-b68e3edfed9c041c96a8f879d8849d7cb6d0f2ac015118e220db7e6714684a8b WatchSource:0}: Error finding container b68e3edfed9c041c96a8f879d8849d7cb6d0f2ac015118e220db7e6714684a8b: Status 404 returned error can't find the container with id b68e3edfed9c041c96a8f879d8849d7cb6d0f2ac015118e220db7e6714684a8b Jun 08 18:14:58.893797 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:58.893756 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2" event={"ID":"888c9be8-bb70-40de-8743-d87f58d7531f","Type":"ContainerStarted","Data":"6aa39c2db9d51e96bab334abf596dde51d9f4a7b03e30f9be75967437b98fcc3"} Jun 08 18:14:58.896308 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:58.896277 2556 generic.go:356] "Generic (PLEG): container finished" podID="5d9241e3-33dc-4716-b9fe-f473039c5613" containerID="e57d7cb28b03d4d882ac36c709f3b2be270ce07fee26a83a722f5b57c0fde1f5" exitCode=0 Jun 08 18:14:58.896485 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:58.896368 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" event={"ID":"5d9241e3-33dc-4716-b9fe-f473039c5613","Type":"ContainerDied","Data":"e57d7cb28b03d4d882ac36c709f3b2be270ce07fee26a83a722f5b57c0fde1f5"} Jun 08 18:14:58.897660 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:14:58.897625 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w" event={"ID":"2d5d0b19-db09-4322-baba-cbece9af39b8","Type":"ContainerStarted","Data":"b68e3edfed9c041c96a8f879d8849d7cb6d0f2ac015118e220db7e6714684a8b"} Jun 08 18:15:00.038235 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:00.038176 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:00.909292 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:00.909254 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2" event={"ID":"888c9be8-bb70-40de-8743-d87f58d7531f","Type":"ContainerStarted","Data":"82cdc3188c3974f8132a10bea38538a276f119255dbb6693bce7cf76215aa598"} Jun 08 18:15:00.911506 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:00.911475 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" event={"ID":"5d9241e3-33dc-4716-b9fe-f473039c5613","Type":"ContainerDied","Data":"0ae74c8a87a6f3a3d827f685b49177e84d503c0d8c9d7dfde16d68298f3c544d"} Jun 08 18:15:00.911638 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:00.911565 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ae74c8a87a6f3a3d827f685b49177e84d503c0d8c9d7dfde16d68298f3c544d" Jun 08 18:15:00.916129 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:00.916105 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" Jun 08 18:15:00.926089 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:00.926046 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f99d56dcb-wdsn2" podStartSLOduration=2.588313896 podStartE2EDuration="3.926032524s" totalImagesPullingTime="1.337718628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:14:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:15:00.925249555 +0000 UTC m=+458.021749026" watchObservedRunningTime="2026-06-08 18:15:00.926032524 +0000 UTC m=+458.022531993" Jun 08 18:15:00.977033 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:00.977005 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4sr8\" (UniqueName: \"kubernetes.io/projected/5d9241e3-33dc-4716-b9fe-f473039c5613-kube-api-access-h4sr8\") pod \"5d9241e3-33dc-4716-b9fe-f473039c5613\" (UID: \"5d9241e3-33dc-4716-b9fe-f473039c5613\") " Jun 08 18:15:00.977210 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:00.977118 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d9241e3-33dc-4716-b9fe-f473039c5613-util\") pod \"5d9241e3-33dc-4716-b9fe-f473039c5613\" (UID: \"5d9241e3-33dc-4716-b9fe-f473039c5613\") " Jun 08 18:15:00.977210 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:00.977158 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d9241e3-33dc-4716-b9fe-f473039c5613-bundle\") pod \"5d9241e3-33dc-4716-b9fe-f473039c5613\" (UID: \"5d9241e3-33dc-4716-b9fe-f473039c5613\") " Jun 08 18:15:00.978142 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:00.978107 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d9241e3-33dc-4716-b9fe-f473039c5613-bundle" (OuterVolumeSpecName: "bundle") pod "5d9241e3-33dc-4716-b9fe-f473039c5613" (UID: "5d9241e3-33dc-4716-b9fe-f473039c5613"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:15:00.979766 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:00.979733 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d9241e3-33dc-4716-b9fe-f473039c5613-kube-api-access-h4sr8" (OuterVolumeSpecName: "kube-api-access-h4sr8") pod "5d9241e3-33dc-4716-b9fe-f473039c5613" (UID: "5d9241e3-33dc-4716-b9fe-f473039c5613"). InnerVolumeSpecName "kube-api-access-h4sr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:15:00.982555 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:00.982528 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d9241e3-33dc-4716-b9fe-f473039c5613-util" (OuterVolumeSpecName: "util") pod "5d9241e3-33dc-4716-b9fe-f473039c5613" (UID: "5d9241e3-33dc-4716-b9fe-f473039c5613"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:15:01.078291 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:01.078256 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d9241e3-33dc-4716-b9fe-f473039c5613-util\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:15:01.078291 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:01.078287 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d9241e3-33dc-4716-b9fe-f473039c5613-bundle\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:15:01.078708 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:01.078300 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4sr8\" (UniqueName: \"kubernetes.io/projected/5d9241e3-33dc-4716-b9fe-f473039c5613-kube-api-access-h4sr8\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:15:01.916102 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:01.916072 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19ddz56k" Jun 08 18:15:02.921992 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:02.921959 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w" event={"ID":"2d5d0b19-db09-4322-baba-cbece9af39b8","Type":"ContainerStarted","Data":"f65a3eb2683768f6e5a8672a18145d1713ee0cd82c2bcf29bb156df7b4406b21"} Jun 08 18:15:02.922458 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:02.922155 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w" Jun 08 18:15:02.923649 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:02.923620 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w" podUID="2d5d0b19-db09-4322-baba-cbece9af39b8" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.21:8000/readyz\": dial tcp 10.132.0.21:8000: connect: connection refused" Jun 08 18:15:02.938227 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:02.938172 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w" podStartSLOduration=1.728133272 podStartE2EDuration="5.938152823s" totalImagesPullingTime="4.210019551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:14:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:15:02.937571635 +0000 UTC m=+460.034071105" watchObservedRunningTime="2026-06-08 18:15:02.938152823 +0000 UTC m=+460.034652295" Jun 08 18:15:03.926470 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:03.926437 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cbd8f549d-6457w" Jun 08 18:15:05.155400 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:05.155339 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:06.537077 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:06.537038 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:07.077954 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.077921 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mxzh"] Jun 08 18:15:07.078203 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.078192 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d9241e3-33dc-4716-b9fe-f473039c5613" containerName="extract" Jun 08 18:15:07.078247 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.078205 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d9241e3-33dc-4716-b9fe-f473039c5613" containerName="extract" Jun 08 18:15:07.078247 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.078218 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d9241e3-33dc-4716-b9fe-f473039c5613" containerName="pull" Jun 08 18:15:07.078247 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.078224 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d9241e3-33dc-4716-b9fe-f473039c5613" containerName="pull" Jun 08 18:15:07.078247 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.078235 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d9241e3-33dc-4716-b9fe-f473039c5613" containerName="util" Jun 08 18:15:07.078247 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.078240 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d9241e3-33dc-4716-b9fe-f473039c5613" containerName="util" Jun 08 18:15:07.078420 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.078290 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d9241e3-33dc-4716-b9fe-f473039c5613" containerName="extract" Jun 08 18:15:07.080855 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.080837 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mxzh" Jun 08 18:15:07.083403 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.083364 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bbbrz\"" Jun 08 18:15:07.083403 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.083365 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 08 18:15:07.083614 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.083403 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 08 18:15:07.094694 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.094667 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mxzh"] Jun 08 18:15:07.131159 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.131121 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4cnn\" (UniqueName: \"kubernetes.io/projected/7c78d643-2c8a-4eff-a409-5ca3f1a4895b-kube-api-access-h4cnn\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6mxzh\" (UID: \"7c78d643-2c8a-4eff-a409-5ca3f1a4895b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mxzh" Jun 08 18:15:07.131349 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.131180 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c78d643-2c8a-4eff-a409-5ca3f1a4895b-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6mxzh\" (UID: \"7c78d643-2c8a-4eff-a409-5ca3f1a4895b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mxzh" Jun 08 18:15:07.232144 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.232104 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4cnn\" (UniqueName: \"kubernetes.io/projected/7c78d643-2c8a-4eff-a409-5ca3f1a4895b-kube-api-access-h4cnn\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6mxzh\" (UID: \"7c78d643-2c8a-4eff-a409-5ca3f1a4895b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mxzh" Jun 08 18:15:07.232288 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.232168 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c78d643-2c8a-4eff-a409-5ca3f1a4895b-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6mxzh\" (UID: \"7c78d643-2c8a-4eff-a409-5ca3f1a4895b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mxzh" Jun 08 18:15:07.232627 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.232608 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c78d643-2c8a-4eff-a409-5ca3f1a4895b-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6mxzh\" (UID: \"7c78d643-2c8a-4eff-a409-5ca3f1a4895b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mxzh" Jun 08 18:15:07.240925 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.240903 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4cnn\" (UniqueName: \"kubernetes.io/projected/7c78d643-2c8a-4eff-a409-5ca3f1a4895b-kube-api-access-h4cnn\") pod \"cert-manager-operator-controller-manager-57757f7cfc-6mxzh\" (UID: \"7c78d643-2c8a-4eff-a409-5ca3f1a4895b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mxzh" Jun 08 18:15:07.389728 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.389644 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mxzh" Jun 08 18:15:07.523453 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.523417 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mxzh"] Jun 08 18:15:07.526366 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:15:07.526333 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c78d643_2c8a_4eff_a409_5ca3f1a4895b.slice/crio-856b4b8767f669d21033bdcf953d3b75a74db6c2762c3edffad4be6d4fcfb08c WatchSource:0}: Error finding container 856b4b8767f669d21033bdcf953d3b75a74db6c2762c3edffad4be6d4fcfb08c: Status 404 returned error can't find the container with id 856b4b8767f669d21033bdcf953d3b75a74db6c2762c3edffad4be6d4fcfb08c Jun 08 18:15:07.945885 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:07.945851 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mxzh" event={"ID":"7c78d643-2c8a-4eff-a409-5ca3f1a4895b","Type":"ContainerStarted","Data":"856b4b8767f669d21033bdcf953d3b75a74db6c2762c3edffad4be6d4fcfb08c"} Jun 08 18:15:08.802598 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:08.802553 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:08.905050 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:08.905006 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:09.956287 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:09.956249 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mxzh" event={"ID":"7c78d643-2c8a-4eff-a409-5ca3f1a4895b","Type":"ContainerStarted","Data":"fc0a088b7d918c1bb987e634b7c527efcb05f82231600f07a087365b3b63fb34"} Jun 08 18:15:09.974338 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:09.974297 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:09.988066 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:09.988011 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-6mxzh" podStartSLOduration=1.298493025 podStartE2EDuration="2.987996534s" totalImagesPullingTime="1.689503509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:15:09.986721869 +0000 UTC m=+467.083221341" watchObservedRunningTime="2026-06-08 18:15:09.987996534 +0000 UTC m=+467.084496003" Jun 08 18:15:10.074500 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:10.074466 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:10.447950 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:10.447917 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:10.548080 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:10.548042 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:11.802117 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:11.802082 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf"] Jun 08 18:15:11.805604 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:11.805587 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" Jun 08 18:15:11.808205 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:11.808184 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 18:15:11.809274 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:11.809255 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nj8pv\"" Jun 08 18:15:11.809327 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:11.809255 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 18:15:11.813960 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:11.813936 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf"] Jun 08 18:15:11.870119 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:11.870079 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0a12a7e-3a26-4cd8-926a-c9088186fb07-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf\" (UID: \"a0a12a7e-3a26-4cd8-926a-c9088186fb07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" Jun 08 18:15:11.870295 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:11.870194 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0a12a7e-3a26-4cd8-926a-c9088186fb07-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf\" (UID: \"a0a12a7e-3a26-4cd8-926a-c9088186fb07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" Jun 08 18:15:11.870295 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:11.870222 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2d47\" (UniqueName: \"kubernetes.io/projected/a0a12a7e-3a26-4cd8-926a-c9088186fb07-kube-api-access-d2d47\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf\" (UID: \"a0a12a7e-3a26-4cd8-926a-c9088186fb07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" Jun 08 18:15:11.971022 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:11.970986 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0a12a7e-3a26-4cd8-926a-c9088186fb07-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf\" (UID: \"a0a12a7e-3a26-4cd8-926a-c9088186fb07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" Jun 08 18:15:11.971022 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:11.971024 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2d47\" (UniqueName: \"kubernetes.io/projected/a0a12a7e-3a26-4cd8-926a-c9088186fb07-kube-api-access-d2d47\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf\" (UID: \"a0a12a7e-3a26-4cd8-926a-c9088186fb07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" Jun 08 18:15:11.971297 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:11.971049 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0a12a7e-3a26-4cd8-926a-c9088186fb07-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf\" (UID: \"a0a12a7e-3a26-4cd8-926a-c9088186fb07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" Jun 08 18:15:11.971442 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:11.971419 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0a12a7e-3a26-4cd8-926a-c9088186fb07-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf\" (UID: \"a0a12a7e-3a26-4cd8-926a-c9088186fb07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" Jun 08 18:15:11.971501 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:11.971439 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0a12a7e-3a26-4cd8-926a-c9088186fb07-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf\" (UID: \"a0a12a7e-3a26-4cd8-926a-c9088186fb07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" Jun 08 18:15:11.979137 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:11.979090 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2d47\" (UniqueName: \"kubernetes.io/projected/a0a12a7e-3a26-4cd8-926a-c9088186fb07-kube-api-access-d2d47\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf\" (UID: \"a0a12a7e-3a26-4cd8-926a-c9088186fb07\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" Jun 08 18:15:12.115321 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:12.115213 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" Jun 08 18:15:12.245987 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:12.245959 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf"] Jun 08 18:15:12.248430 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:15:12.248404 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0a12a7e_3a26_4cd8_926a_c9088186fb07.slice/crio-67af4390c5ff97c765a3aad35fa0ff31e019e5d65393eeee51f89e38f5e82025 WatchSource:0}: Error finding container 67af4390c5ff97c765a3aad35fa0ff31e019e5d65393eeee51f89e38f5e82025: Status 404 returned error can't find the container with id 67af4390c5ff97c765a3aad35fa0ff31e019e5d65393eeee51f89e38f5e82025 Jun 08 18:15:12.712292 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:12.712255 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-m4v2t"] Jun 08 18:15:12.715407 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:12.715373 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m4v2t" Jun 08 18:15:12.718221 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:12.718196 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 08 18:15:12.718367 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:12.718234 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 08 18:15:12.719270 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:12.719250 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6knvs\"" Jun 08 18:15:12.724338 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:12.724310 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-m4v2t"] Jun 08 18:15:12.778691 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:12.778654 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5856\" (UniqueName: \"kubernetes.io/projected/9b292ef7-8160-4efa-b425-400f0c5f01b4-kube-api-access-m5856\") pod \"cert-manager-webhook-7dc76cbb94-m4v2t\" (UID: \"9b292ef7-8160-4efa-b425-400f0c5f01b4\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m4v2t" Jun 08 18:15:12.778854 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:12.778744 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b292ef7-8160-4efa-b425-400f0c5f01b4-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-m4v2t\" (UID: \"9b292ef7-8160-4efa-b425-400f0c5f01b4\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m4v2t" Jun 08 18:15:12.879143 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:12.879096 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b292ef7-8160-4efa-b425-400f0c5f01b4-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-m4v2t\" (UID: \"9b292ef7-8160-4efa-b425-400f0c5f01b4\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m4v2t" Jun 08 18:15:12.879529 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:12.879152 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5856\" (UniqueName: \"kubernetes.io/projected/9b292ef7-8160-4efa-b425-400f0c5f01b4-kube-api-access-m5856\") pod \"cert-manager-webhook-7dc76cbb94-m4v2t\" (UID: \"9b292ef7-8160-4efa-b425-400f0c5f01b4\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m4v2t" Jun 08 18:15:12.887202 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:12.887177 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5856\" (UniqueName: \"kubernetes.io/projected/9b292ef7-8160-4efa-b425-400f0c5f01b4-kube-api-access-m5856\") pod \"cert-manager-webhook-7dc76cbb94-m4v2t\" (UID: \"9b292ef7-8160-4efa-b425-400f0c5f01b4\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m4v2t" Jun 08 18:15:12.887311 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:12.887218 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b292ef7-8160-4efa-b425-400f0c5f01b4-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-m4v2t\" (UID: \"9b292ef7-8160-4efa-b425-400f0c5f01b4\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-m4v2t" Jun 08 18:15:12.971787 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:12.971756 2556 generic.go:356] "Generic (PLEG): container finished" podID="a0a12a7e-3a26-4cd8-926a-c9088186fb07" containerID="de3a8060c2f55c56a649ea1fcdf1089a27e65dd18810ecfe9b0478089bbc6cd8" exitCode=0 Jun 08 18:15:12.971934 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:12.971801 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" event={"ID":"a0a12a7e-3a26-4cd8-926a-c9088186fb07","Type":"ContainerDied","Data":"de3a8060c2f55c56a649ea1fcdf1089a27e65dd18810ecfe9b0478089bbc6cd8"} Jun 08 18:15:12.971934 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:12.971856 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" event={"ID":"a0a12a7e-3a26-4cd8-926a-c9088186fb07","Type":"ContainerStarted","Data":"67af4390c5ff97c765a3aad35fa0ff31e019e5d65393eeee51f89e38f5e82025"} Jun 08 18:15:13.025118 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:13.025091 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m4v2t" Jun 08 18:15:13.150086 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:13.150063 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-m4v2t"] Jun 08 18:15:13.151906 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:15:13.151878 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b292ef7_8160_4efa_b425_400f0c5f01b4.slice/crio-1f09e41f75f73f0af64c99fcca737c99a332211c7da59e8f37858122c74a49a9 WatchSource:0}: Error finding container 1f09e41f75f73f0af64c99fcca737c99a332211c7da59e8f37858122c74a49a9: Status 404 returned error can't find the container with id 1f09e41f75f73f0af64c99fcca737c99a332211c7da59e8f37858122c74a49a9 Jun 08 18:15:13.277207 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:13.277117 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:13.860498 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:13.860432 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:13.980568 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:13.980523 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m4v2t" event={"ID":"9b292ef7-8160-4efa-b425-400f0c5f01b4","Type":"ContainerStarted","Data":"1f09e41f75f73f0af64c99fcca737c99a332211c7da59e8f37858122c74a49a9"} Jun 08 18:15:15.513484 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:15.513450 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-ftx4m"] Jun 08 18:15:15.517020 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:15.516998 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-ftx4m" Jun 08 18:15:15.519552 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:15.519526 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fxb5p\"" Jun 08 18:15:15.524113 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:15.524088 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-ftx4m"] Jun 08 18:15:15.601437 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:15.601394 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmq2c\" (UniqueName: \"kubernetes.io/projected/50520658-1cfa-4286-b85d-04e17d4db84f-kube-api-access-mmq2c\") pod \"cert-manager-cainjector-5d99449ffd-ftx4m\" (UID: \"50520658-1cfa-4286-b85d-04e17d4db84f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ftx4m" Jun 08 18:15:15.601623 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:15.601462 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50520658-1cfa-4286-b85d-04e17d4db84f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-ftx4m\" (UID: \"50520658-1cfa-4286-b85d-04e17d4db84f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ftx4m" Jun 08 18:15:15.702651 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:15.702613 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmq2c\" (UniqueName: \"kubernetes.io/projected/50520658-1cfa-4286-b85d-04e17d4db84f-kube-api-access-mmq2c\") pod \"cert-manager-cainjector-5d99449ffd-ftx4m\" (UID: \"50520658-1cfa-4286-b85d-04e17d4db84f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ftx4m" Jun 08 18:15:15.702844 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:15.702659 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50520658-1cfa-4286-b85d-04e17d4db84f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-ftx4m\" (UID: \"50520658-1cfa-4286-b85d-04e17d4db84f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ftx4m" Jun 08 18:15:15.711770 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:15.711702 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50520658-1cfa-4286-b85d-04e17d4db84f-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-ftx4m\" (UID: \"50520658-1cfa-4286-b85d-04e17d4db84f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ftx4m" Jun 08 18:15:15.711921 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:15.711856 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmq2c\" (UniqueName: \"kubernetes.io/projected/50520658-1cfa-4286-b85d-04e17d4db84f-kube-api-access-mmq2c\") pod \"cert-manager-cainjector-5d99449ffd-ftx4m\" (UID: \"50520658-1cfa-4286-b85d-04e17d4db84f\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-ftx4m" Jun 08 18:15:15.829334 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:15.829307 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-ftx4m" Jun 08 18:15:15.963605 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:15.963568 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:15.983639 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:15.983551 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-ftx4m"] Jun 08 18:15:15.986411 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:15:15.985820 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50520658_1cfa_4286_b85d_04e17d4db84f.slice/crio-bf8ab4e8946abccd744743fc5a49f517b3baf2ce28315040f5871e0b9c6fe82f WatchSource:0}: Error finding container bf8ab4e8946abccd744743fc5a49f517b3baf2ce28315040f5871e0b9c6fe82f: Status 404 returned error can't find the container with id bf8ab4e8946abccd744743fc5a49f517b3baf2ce28315040f5871e0b9c6fe82f Jun 08 18:15:15.991907 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:15.991882 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m4v2t" event={"ID":"9b292ef7-8160-4efa-b425-400f0c5f01b4","Type":"ContainerStarted","Data":"27663b80ffc4ce64b51af4008f62b1e80f14ed1ed27d34488065de4e5a089cf5"} Jun 08 18:15:15.993694 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:15.993673 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" event={"ID":"a0a12a7e-3a26-4cd8-926a-c9088186fb07","Type":"ContainerStarted","Data":"51c01205d6101b9c302afd197f2087381c73c239aa64f8e6598064f977294f43"} Jun 08 18:15:15.994365 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:15.994349 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m4v2t" Jun 08 18:15:16.011585 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:16.011542 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m4v2t" podStartSLOduration=1.333695016 podStartE2EDuration="4.011526879s" totalImagesPullingTime="2.677831863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:15:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:15:16.009857392 +0000 UTC m=+473.106356863" watchObservedRunningTime="2026-06-08 18:15:16.011526879 +0000 UTC m=+473.108026349" Jun 08 18:15:16.032214 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:16.032191 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:17.000003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:16.999913 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-ftx4m" event={"ID":"50520658-1cfa-4286-b85d-04e17d4db84f","Type":"ContainerStarted","Data":"b0f768fcd1749e10aae48150201582b1144c4973a2818f36297cd4bf01b0c5d2"} Jun 08 18:15:17.000003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:16.999962 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-ftx4m" event={"ID":"50520658-1cfa-4286-b85d-04e17d4db84f","Type":"ContainerStarted","Data":"bf8ab4e8946abccd744743fc5a49f517b3baf2ce28315040f5871e0b9c6fe82f"} Jun 08 18:15:17.001647 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:17.001624 2556 generic.go:356] "Generic (PLEG): container finished" podID="a0a12a7e-3a26-4cd8-926a-c9088186fb07" containerID="51c01205d6101b9c302afd197f2087381c73c239aa64f8e6598064f977294f43" exitCode=0 Jun 08 18:15:17.001752 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:17.001703 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" event={"ID":"a0a12a7e-3a26-4cd8-926a-c9088186fb07","Type":"ContainerDied","Data":"51c01205d6101b9c302afd197f2087381c73c239aa64f8e6598064f977294f43"} Jun 08 18:15:17.020669 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:17.020628 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-ftx4m" podStartSLOduration=2.020612463 podStartE2EDuration="2.020612463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:15:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:15:17.018292413 +0000 UTC m=+474.114791885" watchObservedRunningTime="2026-06-08 18:15:17.020612463 +0000 UTC m=+474.117111932" Jun 08 18:15:18.008277 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:18.008238 2556 generic.go:356] "Generic (PLEG): container finished" podID="a0a12a7e-3a26-4cd8-926a-c9088186fb07" containerID="df7c53cb1e570243c3af0a3bb43276fac198562d92a45d9066e23ad1e481af20" exitCode=0 Jun 08 18:15:18.008766 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:18.008325 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" event={"ID":"a0a12a7e-3a26-4cd8-926a-c9088186fb07","Type":"ContainerDied","Data":"df7c53cb1e570243c3af0a3bb43276fac198562d92a45d9066e23ad1e481af20"} Jun 08 18:15:19.133545 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:19.133519 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" Jun 08 18:15:19.232639 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:19.232601 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0a12a7e-3a26-4cd8-926a-c9088186fb07-bundle\") pod \"a0a12a7e-3a26-4cd8-926a-c9088186fb07\" (UID: \"a0a12a7e-3a26-4cd8-926a-c9088186fb07\") " Jun 08 18:15:19.232809 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:19.232668 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2d47\" (UniqueName: \"kubernetes.io/projected/a0a12a7e-3a26-4cd8-926a-c9088186fb07-kube-api-access-d2d47\") pod \"a0a12a7e-3a26-4cd8-926a-c9088186fb07\" (UID: \"a0a12a7e-3a26-4cd8-926a-c9088186fb07\") " Jun 08 18:15:19.232809 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:19.232688 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0a12a7e-3a26-4cd8-926a-c9088186fb07-util\") pod \"a0a12a7e-3a26-4cd8-926a-c9088186fb07\" (UID: \"a0a12a7e-3a26-4cd8-926a-c9088186fb07\") " Jun 08 18:15:19.233046 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:19.233015 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0a12a7e-3a26-4cd8-926a-c9088186fb07-bundle" (OuterVolumeSpecName: "bundle") pod "a0a12a7e-3a26-4cd8-926a-c9088186fb07" (UID: "a0a12a7e-3a26-4cd8-926a-c9088186fb07"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:15:19.234762 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:19.234736 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0a12a7e-3a26-4cd8-926a-c9088186fb07-kube-api-access-d2d47" (OuterVolumeSpecName: "kube-api-access-d2d47") pod "a0a12a7e-3a26-4cd8-926a-c9088186fb07" (UID: "a0a12a7e-3a26-4cd8-926a-c9088186fb07"). InnerVolumeSpecName "kube-api-access-d2d47". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:15:19.239799 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:19.239774 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0a12a7e-3a26-4cd8-926a-c9088186fb07-util" (OuterVolumeSpecName: "util") pod "a0a12a7e-3a26-4cd8-926a-c9088186fb07" (UID: "a0a12a7e-3a26-4cd8-926a-c9088186fb07"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:15:19.333546 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:19.333468 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2d47\" (UniqueName: \"kubernetes.io/projected/a0a12a7e-3a26-4cd8-926a-c9088186fb07-kube-api-access-d2d47\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:15:19.333546 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:19.333495 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a0a12a7e-3a26-4cd8-926a-c9088186fb07-util\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:15:19.333546 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:19.333504 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a0a12a7e-3a26-4cd8-926a-c9088186fb07-bundle\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:15:20.019000 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:20.018965 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" event={"ID":"a0a12a7e-3a26-4cd8-926a-c9088186fb07","Type":"ContainerDied","Data":"67af4390c5ff97c765a3aad35fa0ff31e019e5d65393eeee51f89e38f5e82025"} Jun 08 18:15:20.019000 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:20.018998 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f926mf" Jun 08 18:15:20.019298 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:20.019011 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67af4390c5ff97c765a3aad35fa0ff31e019e5d65393eeee51f89e38f5e82025" Jun 08 18:15:21.865052 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:21.865021 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:22.004841 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:22.004812 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-m4v2t" Jun 08 18:15:30.689762 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:30.689725 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-vkrjs"] Jun 08 18:15:30.690138 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:30.690025 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a12a7e-3a26-4cd8-926a-c9088186fb07" containerName="pull" Jun 08 18:15:30.690138 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:30.690043 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a12a7e-3a26-4cd8-926a-c9088186fb07" containerName="pull" Jun 08 18:15:30.690138 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:30.690066 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a12a7e-3a26-4cd8-926a-c9088186fb07" containerName="extract" Jun 08 18:15:30.690138 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:30.690076 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a12a7e-3a26-4cd8-926a-c9088186fb07" containerName="extract" Jun 08 18:15:30.690138 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:30.690109 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0a12a7e-3a26-4cd8-926a-c9088186fb07" containerName="util" Jun 08 18:15:30.690138 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:30.690118 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0a12a7e-3a26-4cd8-926a-c9088186fb07" containerName="util" Jun 08 18:15:30.690374 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:30.690190 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0a12a7e-3a26-4cd8-926a-c9088186fb07" containerName="extract" Jun 08 18:15:30.770731 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:30.770689 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-vkrjs"] Jun 08 18:15:30.770889 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:30.770787 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-vkrjs" Jun 08 18:15:30.773539 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:30.773518 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gs8xm\"" Jun 08 18:15:30.828587 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:30.828555 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4eeab806-2a3e-4f0a-81e0-0c410bf29bcd-bound-sa-token\") pod \"cert-manager-59c77684cc-vkrjs\" (UID: \"4eeab806-2a3e-4f0a-81e0-0c410bf29bcd\") " pod="cert-manager/cert-manager-59c77684cc-vkrjs" Jun 08 18:15:30.828745 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:30.828620 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dd46\" (UniqueName: \"kubernetes.io/projected/4eeab806-2a3e-4f0a-81e0-0c410bf29bcd-kube-api-access-6dd46\") pod \"cert-manager-59c77684cc-vkrjs\" (UID: \"4eeab806-2a3e-4f0a-81e0-0c410bf29bcd\") " pod="cert-manager/cert-manager-59c77684cc-vkrjs" Jun 08 18:15:30.929363 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:30.929325 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dd46\" (UniqueName: \"kubernetes.io/projected/4eeab806-2a3e-4f0a-81e0-0c410bf29bcd-kube-api-access-6dd46\") pod \"cert-manager-59c77684cc-vkrjs\" (UID: \"4eeab806-2a3e-4f0a-81e0-0c410bf29bcd\") " pod="cert-manager/cert-manager-59c77684cc-vkrjs" Jun 08 18:15:30.929574 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:30.929428 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4eeab806-2a3e-4f0a-81e0-0c410bf29bcd-bound-sa-token\") pod \"cert-manager-59c77684cc-vkrjs\" (UID: \"4eeab806-2a3e-4f0a-81e0-0c410bf29bcd\") " pod="cert-manager/cert-manager-59c77684cc-vkrjs" Jun 08 18:15:30.938144 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:30.938109 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4eeab806-2a3e-4f0a-81e0-0c410bf29bcd-bound-sa-token\") pod \"cert-manager-59c77684cc-vkrjs\" (UID: \"4eeab806-2a3e-4f0a-81e0-0c410bf29bcd\") " pod="cert-manager/cert-manager-59c77684cc-vkrjs" Jun 08 18:15:30.938327 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:30.938307 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dd46\" (UniqueName: \"kubernetes.io/projected/4eeab806-2a3e-4f0a-81e0-0c410bf29bcd-kube-api-access-6dd46\") pod \"cert-manager-59c77684cc-vkrjs\" (UID: \"4eeab806-2a3e-4f0a-81e0-0c410bf29bcd\") " pod="cert-manager/cert-manager-59c77684cc-vkrjs" Jun 08 18:15:31.080278 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:31.080246 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-vkrjs" Jun 08 18:15:31.231460 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:31.231431 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-vkrjs"] Jun 08 18:15:31.233805 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:15:31.233776 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4eeab806_2a3e_4f0a_81e0_0c410bf29bcd.slice/crio-197b8098d53183d09eb79a9f1620c3b328b937cb72db5877b35fa82955381171 WatchSource:0}: Error finding container 197b8098d53183d09eb79a9f1620c3b328b937cb72db5877b35fa82955381171: Status 404 returned error can't find the container with id 197b8098d53183d09eb79a9f1620c3b328b937cb72db5877b35fa82955381171 Jun 08 18:15:32.070221 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:32.070175 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-vkrjs" event={"ID":"4eeab806-2a3e-4f0a-81e0-0c410bf29bcd","Type":"ContainerStarted","Data":"39c03bbdf0c9d0b04af78fc73e5d3a27267042fc99d6497c775fce53875f7e90"} Jun 08 18:15:32.070221 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:32.070226 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-vkrjs" event={"ID":"4eeab806-2a3e-4f0a-81e0-0c410bf29bcd","Type":"ContainerStarted","Data":"197b8098d53183d09eb79a9f1620c3b328b937cb72db5877b35fa82955381171"} Jun 08 18:15:32.074429 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:32.074401 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:32.086125 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:32.086051 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-vkrjs" podStartSLOduration=2.086036213 podStartE2EDuration="2.086036213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:15:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:15:32.08544848 +0000 UTC m=+489.181947949" watchObservedRunningTime="2026-06-08 18:15:32.086036213 +0000 UTC m=+489.182535682" Jun 08 18:15:32.175709 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:32.175675 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:34.367776 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:34.367736 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:34.486134 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:34.486093 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:40.908403 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:40.908348 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:41.009034 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:41.008974 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:42.595559 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:42.595521 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:42.702939 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:42.702907 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4"] Jun 08 18:15:42.706274 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:42.706256 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" Jun 08 18:15:42.708852 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:42.708817 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nj8pv\"" Jun 08 18:15:42.708852 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:42.708841 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 18:15:42.709072 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:42.708946 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 18:15:42.714871 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:42.714846 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4"] Jun 08 18:15:42.829146 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:42.829101 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4\" (UID: \"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" Jun 08 18:15:42.829146 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:42.829144 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w96k\" (UniqueName: \"kubernetes.io/projected/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-kube-api-access-7w96k\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4\" (UID: \"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" Jun 08 18:15:42.829422 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:42.829170 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4\" (UID: \"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" Jun 08 18:15:42.930044 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:42.929959 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4\" (UID: \"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" Jun 08 18:15:42.930044 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:42.929994 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w96k\" (UniqueName: \"kubernetes.io/projected/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-kube-api-access-7w96k\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4\" (UID: \"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" Jun 08 18:15:42.930044 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:42.930018 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4\" (UID: \"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" Jun 08 18:15:42.930439 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:42.930371 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4\" (UID: \"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" Jun 08 18:15:42.930439 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:42.930432 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4\" (UID: \"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" Jun 08 18:15:42.938354 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:42.938325 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w96k\" (UniqueName: \"kubernetes.io/projected/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-kube-api-access-7w96k\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4\" (UID: \"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" Jun 08 18:15:43.017511 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:43.017472 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" Jun 08 18:15:43.148404 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:43.148354 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4"] Jun 08 18:15:43.153191 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:15:43.153158 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971b4c2d_fd1d_41a2_b83b_d6a7f4fbe704.slice/crio-343d0f5946b7c1114eee66d5106eac066125ae778147b6ccca92f1d92d3348fb WatchSource:0}: Error finding container 343d0f5946b7c1114eee66d5106eac066125ae778147b6ccca92f1d92d3348fb: Status 404 returned error can't find the container with id 343d0f5946b7c1114eee66d5106eac066125ae778147b6ccca92f1d92d3348fb Jun 08 18:15:44.121185 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:44.121144 2556 generic.go:356] "Generic (PLEG): container finished" podID="971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704" containerID="ebab4818d44bc9f573c70c701fdbe1ad0c470bb1a6a83fcfafad185c098b2748" exitCode=0 Jun 08 18:15:44.121599 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:44.121236 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" event={"ID":"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704","Type":"ContainerDied","Data":"ebab4818d44bc9f573c70c701fdbe1ad0c470bb1a6a83fcfafad185c098b2748"} Jun 08 18:15:44.121599 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:44.121293 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" event={"ID":"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704","Type":"ContainerStarted","Data":"343d0f5946b7c1114eee66d5106eac066125ae778147b6ccca92f1d92d3348fb"} Jun 08 18:15:45.127233 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:45.127192 2556 generic.go:356] "Generic (PLEG): container finished" podID="971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704" containerID="8323a5b4eea54ac09d394b74b8c1ed4d64dfbda6a3252342df3b2456983f2d19" exitCode=0 Jun 08 18:15:45.127613 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:45.127248 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" event={"ID":"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704","Type":"ContainerDied","Data":"8323a5b4eea54ac09d394b74b8c1ed4d64dfbda6a3252342df3b2456983f2d19"} Jun 08 18:15:46.134303 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:46.134268 2556 generic.go:356] "Generic (PLEG): container finished" podID="971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704" containerID="78913368ab631fb7de592913690efe8e370cd05ef1dfb953bcc6da5572b9e41e" exitCode=0 Jun 08 18:15:46.134710 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:46.134316 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" event={"ID":"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704","Type":"ContainerDied","Data":"78913368ab631fb7de592913690efe8e370cd05ef1dfb953bcc6da5572b9e41e"} Jun 08 18:15:47.265846 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:47.265818 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" Jun 08 18:15:47.366883 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:47.366850 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-bundle\") pod \"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704\" (UID: \"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704\") " Jun 08 18:15:47.367056 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:47.366923 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-util\") pod \"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704\" (UID: \"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704\") " Jun 08 18:15:47.367056 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:47.366952 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7w96k\" (UniqueName: \"kubernetes.io/projected/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-kube-api-access-7w96k\") pod \"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704\" (UID: \"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704\") " Jun 08 18:15:47.367715 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:47.367683 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-bundle" (OuterVolumeSpecName: "bundle") pod "971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704" (UID: "971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:15:47.369066 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:47.369039 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-kube-api-access-7w96k" (OuterVolumeSpecName: "kube-api-access-7w96k") pod "971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704" (UID: "971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704"). InnerVolumeSpecName "kube-api-access-7w96k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:15:47.372950 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:47.372916 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-util" (OuterVolumeSpecName: "util") pod "971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704" (UID: "971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:15:47.468278 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:47.468242 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-bundle\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:15:47.468278 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:47.468270 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-util\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:15:47.468278 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:47.468280 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w96k\" (UniqueName: \"kubernetes.io/projected/971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704-kube-api-access-7w96k\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:15:48.144674 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:48.144641 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" event={"ID":"971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704","Type":"ContainerDied","Data":"343d0f5946b7c1114eee66d5106eac066125ae778147b6ccca92f1d92d3348fb"} Jun 08 18:15:48.144829 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:48.144691 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="343d0f5946b7c1114eee66d5106eac066125ae778147b6ccca92f1d92d3348fb" Jun 08 18:15:48.144829 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:48.144648 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdb67j4" Jun 08 18:15:57.581208 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:57.581137 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:57.676432 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:57.676392 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:58.200591 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.200556 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:58.401291 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.401256 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:58.510611 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.510573 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:58.561101 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.561071 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd"] Jun 08 18:15:58.561415 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.561402 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704" containerName="util" Jun 08 18:15:58.561415 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.561416 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704" containerName="util" Jun 08 18:15:58.561517 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.561430 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704" containerName="extract" Jun 08 18:15:58.561517 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.561435 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704" containerName="extract" Jun 08 18:15:58.561517 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.561452 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704" containerName="pull" Jun 08 18:15:58.561517 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.561458 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704" containerName="pull" Jun 08 18:15:58.561517 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.561512 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="971b4c2d-fd1d-41a2-b83b-d6a7f4fbe704" containerName="extract" Jun 08 18:15:58.564790 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.564770 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:15:58.568674 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.568644 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 18:15:58.568674 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.568656 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 18:15:58.568882 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.568767 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 18:15:58.568882 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.568863 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 18:15:58.568882 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.568876 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cpnzz\"" Jun 08 18:15:58.581890 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.581865 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd"] Jun 08 18:15:58.661032 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.661001 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2-tmp\") pod \"opendatahub-operator-controller-manager-794487f99d-59ghd\" (UID: \"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2\") " pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:15:58.661230 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.661050 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-794487f99d-59ghd\" (UID: \"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2\") " pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:15:58.661230 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.661074 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2-manifests\") pod \"opendatahub-operator-controller-manager-794487f99d-59ghd\" (UID: \"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2\") " pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:15:58.661230 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.661095 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhc5p\" (UniqueName: \"kubernetes.io/projected/fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2-kube-api-access-hhc5p\") pod \"opendatahub-operator-controller-manager-794487f99d-59ghd\" (UID: \"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2\") " pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:15:58.661230 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.661113 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-794487f99d-59ghd\" (UID: \"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2\") " pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:15:58.685510 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.685474 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:58.761869 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.761782 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2-tmp\") pod \"opendatahub-operator-controller-manager-794487f99d-59ghd\" (UID: \"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2\") " pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:15:58.761869 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.761835 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-794487f99d-59ghd\" (UID: \"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2\") " pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:15:58.761869 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.761858 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2-manifests\") pod \"opendatahub-operator-controller-manager-794487f99d-59ghd\" (UID: \"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2\") " pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:15:58.762097 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.761876 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhc5p\" (UniqueName: \"kubernetes.io/projected/fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2-kube-api-access-hhc5p\") pod \"opendatahub-operator-controller-manager-794487f99d-59ghd\" (UID: \"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2\") " pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:15:58.762097 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.761893 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-794487f99d-59ghd\" (UID: \"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2\") " pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:15:58.762314 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.762278 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2-manifests\") pod \"opendatahub-operator-controller-manager-794487f99d-59ghd\" (UID: \"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2\") " pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:15:58.764239 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.764206 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2-tmp\") pod \"opendatahub-operator-controller-manager-794487f99d-59ghd\" (UID: \"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2\") " pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:15:58.764557 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.764537 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-794487f99d-59ghd\" (UID: \"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2\") " pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:15:58.764641 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.764553 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-794487f99d-59ghd\" (UID: \"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2\") " pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:15:58.783137 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.783088 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:58.783442 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.783423 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhc5p\" (UniqueName: \"kubernetes.io/projected/fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2-kube-api-access-hhc5p\") pod \"opendatahub-operator-controller-manager-794487f99d-59ghd\" (UID: \"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2\") " pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:15:58.875822 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.875776 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:15:58.887436 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.887406 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:58.991132 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:58.991085 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:59.038895 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.038818 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd"] Jun 08 18:15:59.043874 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:15:59.043844 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc90f6f6_bb0a_48e5_9a51_e7a8f36e84d2.slice/crio-aa5d63f0c54e55698f74eff2f2921c68b61ba0bbea2bc11377b170bdbe783808 WatchSource:0}: Error finding container aa5d63f0c54e55698f74eff2f2921c68b61ba0bbea2bc11377b170bdbe783808: Status 404 returned error can't find the container with id aa5d63f0c54e55698f74eff2f2921c68b61ba0bbea2bc11377b170bdbe783808 Jun 08 18:15:59.055250 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.055225 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5"] Jun 08 18:15:59.059677 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.059659 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" Jun 08 18:15:59.062281 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.062262 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 08 18:15:59.062613 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.062595 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 08 18:15:59.062738 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.062719 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 18:15:59.062960 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.062926 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 18:15:59.063055 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.063037 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 08 18:15:59.063446 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.063429 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5sb7s\"" Jun 08 18:15:59.074782 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.074753 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5"] Jun 08 18:15:59.093824 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.093791 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:15:59.164575 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.164541 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz5t8\" (UniqueName: \"kubernetes.io/projected/d0c4406e-1f86-4ccf-9920-4a9a5579cf88-kube-api-access-gz5t8\") pod \"lws-controller-manager-59f576b8b8-jghh5\" (UID: \"d0c4406e-1f86-4ccf-9920-4a9a5579cf88\") " pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" Jun 08 18:15:59.164757 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.164593 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d0c4406e-1f86-4ccf-9920-4a9a5579cf88-metrics-cert\") pod \"lws-controller-manager-59f576b8b8-jghh5\" (UID: \"d0c4406e-1f86-4ccf-9920-4a9a5579cf88\") " pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" Jun 08 18:15:59.164757 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.164642 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d0c4406e-1f86-4ccf-9920-4a9a5579cf88-manager-config\") pod \"lws-controller-manager-59f576b8b8-jghh5\" (UID: \"d0c4406e-1f86-4ccf-9920-4a9a5579cf88\") " pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" Jun 08 18:15:59.164757 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.164688 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0c4406e-1f86-4ccf-9920-4a9a5579cf88-cert\") pod \"lws-controller-manager-59f576b8b8-jghh5\" (UID: \"d0c4406e-1f86-4ccf-9920-4a9a5579cf88\") " pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" Jun 08 18:15:59.194669 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.194632 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" event={"ID":"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2","Type":"ContainerStarted","Data":"aa5d63f0c54e55698f74eff2f2921c68b61ba0bbea2bc11377b170bdbe783808"} Jun 08 18:15:59.265625 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.265586 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz5t8\" (UniqueName: \"kubernetes.io/projected/d0c4406e-1f86-4ccf-9920-4a9a5579cf88-kube-api-access-gz5t8\") pod \"lws-controller-manager-59f576b8b8-jghh5\" (UID: \"d0c4406e-1f86-4ccf-9920-4a9a5579cf88\") " pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" Jun 08 18:15:59.265806 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.265634 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d0c4406e-1f86-4ccf-9920-4a9a5579cf88-metrics-cert\") pod \"lws-controller-manager-59f576b8b8-jghh5\" (UID: \"d0c4406e-1f86-4ccf-9920-4a9a5579cf88\") " pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" Jun 08 18:15:59.265806 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.265702 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d0c4406e-1f86-4ccf-9920-4a9a5579cf88-manager-config\") pod \"lws-controller-manager-59f576b8b8-jghh5\" (UID: \"d0c4406e-1f86-4ccf-9920-4a9a5579cf88\") " pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" Jun 08 18:15:59.265806 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.265745 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0c4406e-1f86-4ccf-9920-4a9a5579cf88-cert\") pod \"lws-controller-manager-59f576b8b8-jghh5\" (UID: \"d0c4406e-1f86-4ccf-9920-4a9a5579cf88\") " pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" Jun 08 18:15:59.266389 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.266354 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d0c4406e-1f86-4ccf-9920-4a9a5579cf88-manager-config\") pod \"lws-controller-manager-59f576b8b8-jghh5\" (UID: \"d0c4406e-1f86-4ccf-9920-4a9a5579cf88\") " pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" Jun 08 18:15:59.268067 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.268045 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d0c4406e-1f86-4ccf-9920-4a9a5579cf88-metrics-cert\") pod \"lws-controller-manager-59f576b8b8-jghh5\" (UID: \"d0c4406e-1f86-4ccf-9920-4a9a5579cf88\") " pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" Jun 08 18:15:59.268156 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.268093 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0c4406e-1f86-4ccf-9920-4a9a5579cf88-cert\") pod \"lws-controller-manager-59f576b8b8-jghh5\" (UID: \"d0c4406e-1f86-4ccf-9920-4a9a5579cf88\") " pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" Jun 08 18:15:59.273793 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.273769 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz5t8\" (UniqueName: \"kubernetes.io/projected/d0c4406e-1f86-4ccf-9920-4a9a5579cf88-kube-api-access-gz5t8\") pod \"lws-controller-manager-59f576b8b8-jghh5\" (UID: \"d0c4406e-1f86-4ccf-9920-4a9a5579cf88\") " pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" Jun 08 18:15:59.369770 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.369695 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" Jun 08 18:15:59.504957 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:15:59.504923 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5"] Jun 08 18:15:59.507580 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:15:59.507547 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0c4406e_1f86_4ccf_9920_4a9a5579cf88.slice/crio-dfa1645205b8f51d8272c2a0fc4b3a9bf013852544fac44e7b0172b34e8d4d3b WatchSource:0}: Error finding container dfa1645205b8f51d8272c2a0fc4b3a9bf013852544fac44e7b0172b34e8d4d3b: Status 404 returned error can't find the container with id dfa1645205b8f51d8272c2a0fc4b3a9bf013852544fac44e7b0172b34e8d4d3b Jun 08 18:16:00.201857 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:00.201778 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" event={"ID":"d0c4406e-1f86-4ccf-9920-4a9a5579cf88","Type":"ContainerStarted","Data":"dfa1645205b8f51d8272c2a0fc4b3a9bf013852544fac44e7b0172b34e8d4d3b"} Jun 08 18:16:03.220521 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:03.220482 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" event={"ID":"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2","Type":"ContainerStarted","Data":"5d933221706ab4968b082fae24e7a2eb5200c691078f03ca407c0b13267ae73a"} Jun 08 18:16:03.222049 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:03.222022 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" event={"ID":"d0c4406e-1f86-4ccf-9920-4a9a5579cf88","Type":"ContainerStarted","Data":"50212e134891def2eebfaa2d2ad0d4ef263ef455852faa397fb7161b3963be14"} Jun 08 18:16:03.222171 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:03.222076 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" Jun 08 18:16:03.261240 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:03.261190 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" podStartSLOduration=1.491649571 podStartE2EDuration="4.261174068s" totalImagesPullingTime="2.769524497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:15:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:16:03.260334138 +0000 UTC m=+520.356833609" watchObservedRunningTime="2026-06-08 18:16:03.261174068 +0000 UTC m=+520.357673595" Jun 08 18:16:04.228199 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:04.228167 2556 generic.go:356] "Generic (PLEG): container finished" podID="fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2" containerID="5d933221706ab4968b082fae24e7a2eb5200c691078f03ca407c0b13267ae73a" exitCode=0 Jun 08 18:16:04.228727 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:04.228257 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" event={"ID":"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2","Type":"ContainerDied","Data":"5d933221706ab4968b082fae24e7a2eb5200c691078f03ca407c0b13267ae73a"} Jun 08 18:16:05.234863 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:05.234827 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" event={"ID":"fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2","Type":"ContainerStarted","Data":"fe93ec32378a2983995160b3ba55aabf06f08519de249814a1bb002dc19a8c6e"} Jun 08 18:16:05.235262 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:05.234949 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:16:05.257569 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:05.257520 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" podStartSLOduration=2.676977316 podStartE2EDuration="7.257504277s" totalImagesPullingTime="3.526405178s" totalInitContainerRuntime="1.054121783s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:15:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:16:05.255492415 +0000 UTC m=+522.351991887" watchObservedRunningTime="2026-06-08 18:16:05.257504277 +0000 UTC m=+522.354003746" Jun 08 18:16:09.394910 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:09.394875 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:09.496049 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:09.496017 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:14.230890 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:14.230801 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-59f576b8b8-jghh5" Jun 08 18:16:16.241762 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:16.241730 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-794487f99d-59ghd" Jun 08 18:16:18.815268 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:18.815192 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:18.979777 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:18.979735 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:19.262674 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:19.262624 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:19.451562 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:19.451532 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:19.564778 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:19.564686 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:19.683850 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:19.683810 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:20.067584 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:20.067550 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:20.177678 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:20.177644 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:20.266745 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:20.266710 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:20.366491 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:20.366403 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:20.881883 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:20.881846 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:20.977958 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:20.977926 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:21.155626 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:21.155540 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf"] Jun 08 18:16:21.163076 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:21.163051 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" Jun 08 18:16:21.165819 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:21.165799 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 18:16:21.165928 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:21.165856 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 18:16:21.166828 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:21.166809 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nj8pv\"" Jun 08 18:16:21.171094 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:21.171067 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf"] Jun 08 18:16:21.263649 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:21.263616 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8be51998-4fff-40dc-8c22-01cba4fb02c5-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf\" (UID: \"8be51998-4fff-40dc-8c22-01cba4fb02c5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" Jun 08 18:16:21.263861 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:21.263679 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8be51998-4fff-40dc-8c22-01cba4fb02c5-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf\" (UID: \"8be51998-4fff-40dc-8c22-01cba4fb02c5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" Jun 08 18:16:21.263861 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:21.263745 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xlk9\" (UniqueName: \"kubernetes.io/projected/8be51998-4fff-40dc-8c22-01cba4fb02c5-kube-api-access-6xlk9\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf\" (UID: \"8be51998-4fff-40dc-8c22-01cba4fb02c5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" Jun 08 18:16:21.364713 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:21.364680 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xlk9\" (UniqueName: \"kubernetes.io/projected/8be51998-4fff-40dc-8c22-01cba4fb02c5-kube-api-access-6xlk9\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf\" (UID: \"8be51998-4fff-40dc-8c22-01cba4fb02c5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" Jun 08 18:16:21.364923 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:21.364745 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8be51998-4fff-40dc-8c22-01cba4fb02c5-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf\" (UID: \"8be51998-4fff-40dc-8c22-01cba4fb02c5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" Jun 08 18:16:21.364923 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:21.364782 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8be51998-4fff-40dc-8c22-01cba4fb02c5-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf\" (UID: \"8be51998-4fff-40dc-8c22-01cba4fb02c5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" Jun 08 18:16:21.365127 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:21.365107 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8be51998-4fff-40dc-8c22-01cba4fb02c5-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf\" (UID: \"8be51998-4fff-40dc-8c22-01cba4fb02c5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" Jun 08 18:16:21.365174 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:21.365134 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8be51998-4fff-40dc-8c22-01cba4fb02c5-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf\" (UID: \"8be51998-4fff-40dc-8c22-01cba4fb02c5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" Jun 08 18:16:21.377169 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:21.377145 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xlk9\" (UniqueName: \"kubernetes.io/projected/8be51998-4fff-40dc-8c22-01cba4fb02c5-kube-api-access-6xlk9\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf\" (UID: \"8be51998-4fff-40dc-8c22-01cba4fb02c5\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" Jun 08 18:16:21.473174 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:21.473130 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" Jun 08 18:16:21.609753 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:21.609716 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf"] Jun 08 18:16:21.614252 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:16:21.614218 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be51998_4fff_40dc_8c22_01cba4fb02c5.slice/crio-e8cc36bc5fbe74baf2829acaae82e134f83bd4f70aa6e4908326b12078021455 WatchSource:0}: Error finding container e8cc36bc5fbe74baf2829acaae82e134f83bd4f70aa6e4908326b12078021455: Status 404 returned error can't find the container with id e8cc36bc5fbe74baf2829acaae82e134f83bd4f70aa6e4908326b12078021455 Jun 08 18:16:22.314278 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:22.314243 2556 generic.go:356] "Generic (PLEG): container finished" podID="8be51998-4fff-40dc-8c22-01cba4fb02c5" containerID="72b5dcb1b9ceb7f8b9aafcf0527e27e12c72c6af25c170174a615e9b2c3b5ecc" exitCode=0 Jun 08 18:16:22.314690 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:22.314325 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" event={"ID":"8be51998-4fff-40dc-8c22-01cba4fb02c5","Type":"ContainerDied","Data":"72b5dcb1b9ceb7f8b9aafcf0527e27e12c72c6af25c170174a615e9b2c3b5ecc"} Jun 08 18:16:22.314690 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:22.314372 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" event={"ID":"8be51998-4fff-40dc-8c22-01cba4fb02c5","Type":"ContainerStarted","Data":"e8cc36bc5fbe74baf2829acaae82e134f83bd4f70aa6e4908326b12078021455"} Jun 08 18:16:24.325408 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:24.325350 2556 generic.go:356] "Generic (PLEG): container finished" podID="8be51998-4fff-40dc-8c22-01cba4fb02c5" containerID="f4793a4bf68bfe5449de05706f6016e5dddf7c572779dd1c7d901edbcaf6a0e0" exitCode=0 Jun 08 18:16:24.325772 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:24.325440 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" event={"ID":"8be51998-4fff-40dc-8c22-01cba4fb02c5","Type":"ContainerDied","Data":"f4793a4bf68bfe5449de05706f6016e5dddf7c572779dd1c7d901edbcaf6a0e0"} Jun 08 18:16:24.547828 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:16:24.547790 2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be51998_4fff_40dc_8c22_01cba4fb02c5.slice/crio-conmon-eed7709990e33e188aa444bc0e1a9330de533f4dba9c153c6be70a777756a2e3.scope\": RecentStats: unable to find data in memory cache]" Jun 08 18:16:25.331724 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:25.331691 2556 generic.go:356] "Generic (PLEG): container finished" podID="8be51998-4fff-40dc-8c22-01cba4fb02c5" containerID="eed7709990e33e188aa444bc0e1a9330de533f4dba9c153c6be70a777756a2e3" exitCode=0 Jun 08 18:16:25.332128 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:25.331773 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" event={"ID":"8be51998-4fff-40dc-8c22-01cba4fb02c5","Type":"ContainerDied","Data":"eed7709990e33e188aa444bc0e1a9330de533f4dba9c153c6be70a777756a2e3"} Jun 08 18:16:26.473113 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:26.473082 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" Jun 08 18:16:26.612898 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:26.612811 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8be51998-4fff-40dc-8c22-01cba4fb02c5-bundle\") pod \"8be51998-4fff-40dc-8c22-01cba4fb02c5\" (UID: \"8be51998-4fff-40dc-8c22-01cba4fb02c5\") " Jun 08 18:16:26.613041 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:26.612917 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xlk9\" (UniqueName: \"kubernetes.io/projected/8be51998-4fff-40dc-8c22-01cba4fb02c5-kube-api-access-6xlk9\") pod \"8be51998-4fff-40dc-8c22-01cba4fb02c5\" (UID: \"8be51998-4fff-40dc-8c22-01cba4fb02c5\") " Jun 08 18:16:26.613041 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:26.612946 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8be51998-4fff-40dc-8c22-01cba4fb02c5-util\") pod \"8be51998-4fff-40dc-8c22-01cba4fb02c5\" (UID: \"8be51998-4fff-40dc-8c22-01cba4fb02c5\") " Jun 08 18:16:26.614053 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:26.614018 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8be51998-4fff-40dc-8c22-01cba4fb02c5-bundle" (OuterVolumeSpecName: "bundle") pod "8be51998-4fff-40dc-8c22-01cba4fb02c5" (UID: "8be51998-4fff-40dc-8c22-01cba4fb02c5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:16:26.615247 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:26.615218 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8be51998-4fff-40dc-8c22-01cba4fb02c5-kube-api-access-6xlk9" (OuterVolumeSpecName: "kube-api-access-6xlk9") pod "8be51998-4fff-40dc-8c22-01cba4fb02c5" (UID: "8be51998-4fff-40dc-8c22-01cba4fb02c5"). InnerVolumeSpecName "kube-api-access-6xlk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:16:26.619338 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:26.619314 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8be51998-4fff-40dc-8c22-01cba4fb02c5-util" (OuterVolumeSpecName: "util") pod "8be51998-4fff-40dc-8c22-01cba4fb02c5" (UID: "8be51998-4fff-40dc-8c22-01cba4fb02c5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:16:26.714318 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:26.714290 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8be51998-4fff-40dc-8c22-01cba4fb02c5-bundle\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:16:26.714318 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:26.714318 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xlk9\" (UniqueName: \"kubernetes.io/projected/8be51998-4fff-40dc-8c22-01cba4fb02c5-kube-api-access-6xlk9\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:16:26.714318 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:26.714328 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8be51998-4fff-40dc-8c22-01cba4fb02c5-util\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:16:27.342446 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:27.342420 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" Jun 08 18:16:27.342592 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:27.342415 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab0647lcf" event={"ID":"8be51998-4fff-40dc-8c22-01cba4fb02c5","Type":"ContainerDied","Data":"e8cc36bc5fbe74baf2829acaae82e134f83bd4f70aa6e4908326b12078021455"} Jun 08 18:16:27.342592 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:27.342536 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8cc36bc5fbe74baf2829acaae82e134f83bd4f70aa6e4908326b12078021455" Jun 08 18:16:30.860861 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:30.860824 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:30.969815 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:30.969777 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:31.073655 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:31.073614 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:32.108653 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:32.108617 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:32.207619 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:32.207577 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:32.403484 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:32.403404 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:32.479630 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:32.479597 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:34.983808 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:34.983773 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:35.087453 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:35.087421 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:36.257766 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.257731 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:36.301555 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.301516 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh"] Jun 08 18:16:36.301829 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.301815 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be51998-4fff-40dc-8c22-01cba4fb02c5" containerName="util" Jun 08 18:16:36.301829 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.301828 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be51998-4fff-40dc-8c22-01cba4fb02c5" containerName="util" Jun 08 18:16:36.301966 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.301840 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be51998-4fff-40dc-8c22-01cba4fb02c5" containerName="extract" Jun 08 18:16:36.301966 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.301846 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be51998-4fff-40dc-8c22-01cba4fb02c5" containerName="extract" Jun 08 18:16:36.301966 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.301864 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be51998-4fff-40dc-8c22-01cba4fb02c5" containerName="pull" Jun 08 18:16:36.301966 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.301869 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be51998-4fff-40dc-8c22-01cba4fb02c5" containerName="pull" Jun 08 18:16:36.301966 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.301922 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8be51998-4fff-40dc-8c22-01cba4fb02c5" containerName="extract" Jun 08 18:16:36.305356 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.305328 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" Jun 08 18:16:36.308216 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.308184 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 18:16:36.308216 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.308206 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nj8pv\"" Jun 08 18:16:36.308372 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.308186 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 18:16:36.317798 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.317771 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh"] Jun 08 18:16:36.353996 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.353961 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:36.400445 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.400405 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce091014-7bc2-4bdf-a77f-7cfcf34df759-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh\" (UID: \"ce091014-7bc2-4bdf-a77f-7cfcf34df759\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" Jun 08 18:16:36.400608 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.400480 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce091014-7bc2-4bdf-a77f-7cfcf34df759-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh\" (UID: \"ce091014-7bc2-4bdf-a77f-7cfcf34df759\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" Jun 08 18:16:36.400608 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.400523 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4s67\" (UniqueName: \"kubernetes.io/projected/ce091014-7bc2-4bdf-a77f-7cfcf34df759-kube-api-access-j4s67\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh\" (UID: \"ce091014-7bc2-4bdf-a77f-7cfcf34df759\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" Jun 08 18:16:36.500966 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.500925 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce091014-7bc2-4bdf-a77f-7cfcf34df759-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh\" (UID: \"ce091014-7bc2-4bdf-a77f-7cfcf34df759\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" Jun 08 18:16:36.501175 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.500982 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4s67\" (UniqueName: \"kubernetes.io/projected/ce091014-7bc2-4bdf-a77f-7cfcf34df759-kube-api-access-j4s67\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh\" (UID: \"ce091014-7bc2-4bdf-a77f-7cfcf34df759\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" Jun 08 18:16:36.501175 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.501025 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce091014-7bc2-4bdf-a77f-7cfcf34df759-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh\" (UID: \"ce091014-7bc2-4bdf-a77f-7cfcf34df759\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" Jun 08 18:16:36.501437 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.501373 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce091014-7bc2-4bdf-a77f-7cfcf34df759-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh\" (UID: \"ce091014-7bc2-4bdf-a77f-7cfcf34df759\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" Jun 08 18:16:36.501437 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.501424 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce091014-7bc2-4bdf-a77f-7cfcf34df759-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh\" (UID: \"ce091014-7bc2-4bdf-a77f-7cfcf34df759\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" Jun 08 18:16:36.514294 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.514225 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4s67\" (UniqueName: \"kubernetes.io/projected/ce091014-7bc2-4bdf-a77f-7cfcf34df759-kube-api-access-j4s67\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh\" (UID: \"ce091014-7bc2-4bdf-a77f-7cfcf34df759\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" Jun 08 18:16:36.615256 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.615213 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" Jun 08 18:16:36.772507 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:16:36.772470 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce091014_7bc2_4bdf_a77f_7cfcf34df759.slice/crio-1af3d9cd55957a47c9eac4ea8918da916b5f4883d472c552b144025d8a3c15e2 WatchSource:0}: Error finding container 1af3d9cd55957a47c9eac4ea8918da916b5f4883d472c552b144025d8a3c15e2: Status 404 returned error can't find the container with id 1af3d9cd55957a47c9eac4ea8918da916b5f4883d472c552b144025d8a3c15e2 Jun 08 18:16:36.777466 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:36.777431 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh"] Jun 08 18:16:37.010952 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:37.010895 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:37.375213 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:37.375171 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:37.388277 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:37.388249 2556 generic.go:356] "Generic (PLEG): container finished" podID="ce091014-7bc2-4bdf-a77f-7cfcf34df759" containerID="b6e8d279ba0d9aadbd3faf37370dd0bcfb5dd1f8fd8fcbaad0a265bc1806591b" exitCode=0 Jun 08 18:16:37.388452 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:37.388332 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" event={"ID":"ce091014-7bc2-4bdf-a77f-7cfcf34df759","Type":"ContainerDied","Data":"b6e8d279ba0d9aadbd3faf37370dd0bcfb5dd1f8fd8fcbaad0a265bc1806591b"} Jun 08 18:16:37.388452 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:37.388404 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" event={"ID":"ce091014-7bc2-4bdf-a77f-7cfcf34df759","Type":"ContainerStarted","Data":"1af3d9cd55957a47c9eac4ea8918da916b5f4883d472c552b144025d8a3c15e2"} Jun 08 18:16:37.486294 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:37.486254 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:38.394882 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:38.394849 2556 generic.go:356] "Generic (PLEG): container finished" podID="ce091014-7bc2-4bdf-a77f-7cfcf34df759" containerID="2e8d4ff16ccbea4951fda253dbd35446d0070e519d62f5cc7e8f2652b26c4880" exitCode=0 Jun 08 18:16:38.395413 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:38.394912 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" event={"ID":"ce091014-7bc2-4bdf-a77f-7cfcf34df759","Type":"ContainerDied","Data":"2e8d4ff16ccbea4951fda253dbd35446d0070e519d62f5cc7e8f2652b26c4880"} Jun 08 18:16:39.401856 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:39.401816 2556 generic.go:356] "Generic (PLEG): container finished" podID="ce091014-7bc2-4bdf-a77f-7cfcf34df759" containerID="0e20a68c2fd17c039126de5731382a45acc561524f9f1a0420eb55d56d06cb1e" exitCode=0 Jun 08 18:16:39.402313 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:39.401905 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" event={"ID":"ce091014-7bc2-4bdf-a77f-7cfcf34df759","Type":"ContainerDied","Data":"0e20a68c2fd17c039126de5731382a45acc561524f9f1a0420eb55d56d06cb1e"} Jun 08 18:16:40.115623 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:40.115588 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:40.533363 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:40.533332 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" Jun 08 18:16:40.535367 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:40.535346 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4s67\" (UniqueName: \"kubernetes.io/projected/ce091014-7bc2-4bdf-a77f-7cfcf34df759-kube-api-access-j4s67\") pod \"ce091014-7bc2-4bdf-a77f-7cfcf34df759\" (UID: \"ce091014-7bc2-4bdf-a77f-7cfcf34df759\") " Jun 08 18:16:40.535465 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:40.535450 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce091014-7bc2-4bdf-a77f-7cfcf34df759-bundle\") pod \"ce091014-7bc2-4bdf-a77f-7cfcf34df759\" (UID: \"ce091014-7bc2-4bdf-a77f-7cfcf34df759\") " Jun 08 18:16:40.535509 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:40.535482 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce091014-7bc2-4bdf-a77f-7cfcf34df759-util\") pod \"ce091014-7bc2-4bdf-a77f-7cfcf34df759\" (UID: \"ce091014-7bc2-4bdf-a77f-7cfcf34df759\") " Jun 08 18:16:40.536287 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:40.536261 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce091014-7bc2-4bdf-a77f-7cfcf34df759-bundle" (OuterVolumeSpecName: "bundle") pod "ce091014-7bc2-4bdf-a77f-7cfcf34df759" (UID: "ce091014-7bc2-4bdf-a77f-7cfcf34df759"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:16:40.537449 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:40.537424 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce091014-7bc2-4bdf-a77f-7cfcf34df759-kube-api-access-j4s67" (OuterVolumeSpecName: "kube-api-access-j4s67") pod "ce091014-7bc2-4bdf-a77f-7cfcf34df759" (UID: "ce091014-7bc2-4bdf-a77f-7cfcf34df759"). InnerVolumeSpecName "kube-api-access-j4s67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:16:40.541435 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:40.541392 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce091014-7bc2-4bdf-a77f-7cfcf34df759-util" (OuterVolumeSpecName: "util") pod "ce091014-7bc2-4bdf-a77f-7cfcf34df759" (UID: "ce091014-7bc2-4bdf-a77f-7cfcf34df759"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:16:40.636099 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:40.636057 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4s67\" (UniqueName: \"kubernetes.io/projected/ce091014-7bc2-4bdf-a77f-7cfcf34df759-kube-api-access-j4s67\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:16:40.636099 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:40.636094 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ce091014-7bc2-4bdf-a77f-7cfcf34df759-bundle\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:16:40.636099 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:40.636105 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ce091014-7bc2-4bdf-a77f-7cfcf34df759-util\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:16:41.412855 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:41.412827 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" event={"ID":"ce091014-7bc2-4bdf-a77f-7cfcf34df759","Type":"ContainerDied","Data":"1af3d9cd55957a47c9eac4ea8918da916b5f4883d472c552b144025d8a3c15e2"} Jun 08 18:16:41.412855 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:41.412844 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a7frkh" Jun 08 18:16:41.413043 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:41.412871 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1af3d9cd55957a47c9eac4ea8918da916b5f4883d472c552b144025d8a3c15e2" Jun 08 18:16:46.775725 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:46.775682 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:46.864248 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:46.864207 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:47.390882 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:47.390846 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:47.776809 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:47.776772 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:47.877168 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:47.877117 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:50.760434 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:50.760395 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:50.859699 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:50.859668 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:51.019658 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.019579 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p"] Jun 08 18:16:51.019890 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.019878 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce091014-7bc2-4bdf-a77f-7cfcf34df759" containerName="util" Jun 08 18:16:51.019940 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.019891 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce091014-7bc2-4bdf-a77f-7cfcf34df759" containerName="util" Jun 08 18:16:51.019940 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.019905 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce091014-7bc2-4bdf-a77f-7cfcf34df759" containerName="pull" Jun 08 18:16:51.019940 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.019910 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce091014-7bc2-4bdf-a77f-7cfcf34df759" containerName="pull" Jun 08 18:16:51.019940 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.019929 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce091014-7bc2-4bdf-a77f-7cfcf34df759" containerName="extract" Jun 08 18:16:51.019940 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.019935 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce091014-7bc2-4bdf-a77f-7cfcf34df759" containerName="extract" Jun 08 18:16:51.020090 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.019987 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce091014-7bc2-4bdf-a77f-7cfcf34df759" containerName="extract" Jun 08 18:16:51.023035 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.023013 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.025830 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.025810 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 18:16:51.025954 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.025841 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 18:16:51.026211 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.026192 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-s62ml\"" Jun 08 18:16:51.026305 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.026236 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 18:16:51.038443 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.038415 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p"] Jun 08 18:16:51.056662 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.056630 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:51.118710 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.118675 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r7hv\" (UniqueName: \"kubernetes.io/projected/ce148473-f083-4816-b418-e289da63284d-kube-api-access-9r7hv\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.118928 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.118727 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce148473-f083-4816-b418-e289da63284d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.118928 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.118780 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce148473-f083-4816-b418-e289da63284d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.118928 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.118801 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce148473-f083-4816-b418-e289da63284d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.118928 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.118823 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce148473-f083-4816-b418-e289da63284d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.118928 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.118856 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce148473-f083-4816-b418-e289da63284d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.118928 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.118872 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce148473-f083-4816-b418-e289da63284d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.119258 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.118929 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce148473-f083-4816-b418-e289da63284d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.119258 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.118962 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce148473-f083-4816-b418-e289da63284d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.220288 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.220244 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce148473-f083-4816-b418-e289da63284d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.220288 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.220283 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce148473-f083-4816-b418-e289da63284d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.220589 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.220308 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce148473-f083-4816-b418-e289da63284d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.220589 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.220329 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce148473-f083-4816-b418-e289da63284d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.220589 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.220369 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r7hv\" (UniqueName: \"kubernetes.io/projected/ce148473-f083-4816-b418-e289da63284d-kube-api-access-9r7hv\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.220589 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.220443 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce148473-f083-4816-b418-e289da63284d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.220589 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.220471 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce148473-f083-4816-b418-e289da63284d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.220589 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.220500 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce148473-f083-4816-b418-e289da63284d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.220589 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.220525 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce148473-f083-4816-b418-e289da63284d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.220950 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.220737 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce148473-f083-4816-b418-e289da63284d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.221006 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.220959 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce148473-f083-4816-b418-e289da63284d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.221006 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.220986 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce148473-f083-4816-b418-e289da63284d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.221121 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.221059 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce148473-f083-4816-b418-e289da63284d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.221332 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.221314 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce148473-f083-4816-b418-e289da63284d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.222737 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.222715 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce148473-f083-4816-b418-e289da63284d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.222967 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.222951 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce148473-f083-4816-b418-e289da63284d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.228422 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.228399 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce148473-f083-4816-b418-e289da63284d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.232487 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.232455 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r7hv\" (UniqueName: \"kubernetes.io/projected/ce148473-f083-4816-b418-e289da63284d-kube-api-access-9r7hv\") pod \"data-science-gateway-data-science-gateway-class-74759f9795rx46p\" (UID: \"ce148473-f083-4816-b418-e289da63284d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.274878 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.274789 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:51.334718 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.334676 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:51.477926 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.477899 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p"] Jun 08 18:16:51.478784 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:16:51.478746 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce148473_f083_4816_b418_e289da63284d.slice/crio-db5759e11390f20040f0b9e2405d497a24c75e0ca353c1e4acf115b0424c3939 WatchSource:0}: Error finding container db5759e11390f20040f0b9e2405d497a24c75e0ca353c1e4acf115b0424c3939: Status 404 returned error can't find the container with id db5759e11390f20040f0b9e2405d497a24c75e0ca353c1e4acf115b0424c3939 Jun 08 18:16:51.616634 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.616524 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:51.830028 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.829992 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-698f967485-ttqvs"] Jun 08 18:16:51.835093 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.835067 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-698f967485-ttqvs" Jun 08 18:16:51.838355 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.838333 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-cmswt\"" Jun 08 18:16:51.838762 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.838744 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 18:16:51.843460 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.843436 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-698f967485-ttqvs"] Jun 08 18:16:51.870685 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.870609 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:16:51.926821 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.926785 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnp7g\" (UniqueName: \"kubernetes.io/projected/2e0a7774-da9d-428a-94e8-604ca5e14446-kube-api-access-rnp7g\") pod \"dashboard-redirect-698f967485-ttqvs\" (UID: \"2e0a7774-da9d-428a-94e8-604ca5e14446\") " pod="opendatahub/dashboard-redirect-698f967485-ttqvs" Jun 08 18:16:51.926992 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:51.926836 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/2e0a7774-da9d-428a-94e8-604ca5e14446-redirect-config\") pod \"dashboard-redirect-698f967485-ttqvs\" (UID: \"2e0a7774-da9d-428a-94e8-604ca5e14446\") " pod="opendatahub/dashboard-redirect-698f967485-ttqvs" Jun 08 18:16:52.027580 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:52.027541 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/2e0a7774-da9d-428a-94e8-604ca5e14446-redirect-config\") pod \"dashboard-redirect-698f967485-ttqvs\" (UID: \"2e0a7774-da9d-428a-94e8-604ca5e14446\") " pod="opendatahub/dashboard-redirect-698f967485-ttqvs" Jun 08 18:16:52.027755 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:52.027631 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnp7g\" (UniqueName: \"kubernetes.io/projected/2e0a7774-da9d-428a-94e8-604ca5e14446-kube-api-access-rnp7g\") pod \"dashboard-redirect-698f967485-ttqvs\" (UID: \"2e0a7774-da9d-428a-94e8-604ca5e14446\") " pod="opendatahub/dashboard-redirect-698f967485-ttqvs" Jun 08 18:16:52.028237 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:52.028215 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/2e0a7774-da9d-428a-94e8-604ca5e14446-redirect-config\") pod \"dashboard-redirect-698f967485-ttqvs\" (UID: \"2e0a7774-da9d-428a-94e8-604ca5e14446\") " pod="opendatahub/dashboard-redirect-698f967485-ttqvs" Jun 08 18:16:52.040550 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:52.040519 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnp7g\" (UniqueName: \"kubernetes.io/projected/2e0a7774-da9d-428a-94e8-604ca5e14446-kube-api-access-rnp7g\") pod \"dashboard-redirect-698f967485-ttqvs\" (UID: \"2e0a7774-da9d-428a-94e8-604ca5e14446\") " pod="opendatahub/dashboard-redirect-698f967485-ttqvs" Jun 08 18:16:52.147982 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:52.147699 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-698f967485-ttqvs" Jun 08 18:16:52.319211 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:52.319179 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-698f967485-ttqvs"] Jun 08 18:16:52.470500 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:52.470461 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" event={"ID":"ce148473-f083-4816-b418-e289da63284d","Type":"ContainerStarted","Data":"db5759e11390f20040f0b9e2405d497a24c75e0ca353c1e4acf115b0424c3939"} Jun 08 18:16:52.514529 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:16:52.514493 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e0a7774_da9d_428a_94e8_604ca5e14446.slice/crio-000ba8162f5f5dd8b07d99f9c3eb25a4be4f8950bbb1f7b135e779e98474aecb WatchSource:0}: Error finding container 000ba8162f5f5dd8b07d99f9c3eb25a4be4f8950bbb1f7b135e779e98474aecb: Status 404 returned error can't find the container with id 000ba8162f5f5dd8b07d99f9c3eb25a4be4f8950bbb1f7b135e779e98474aecb Jun 08 18:16:53.478017 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:53.477971 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-698f967485-ttqvs" event={"ID":"2e0a7774-da9d-428a-94e8-604ca5e14446","Type":"ContainerStarted","Data":"000ba8162f5f5dd8b07d99f9c3eb25a4be4f8950bbb1f7b135e779e98474aecb"} Jun 08 18:16:54.041982 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:54.041933 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 18:16:54.042095 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:54.042035 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 18:16:54.042095 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:54.042067 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 18:16:54.485821 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:54.485779 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" event={"ID":"ce148473-f083-4816-b418-e289da63284d","Type":"ContainerStarted","Data":"79882093bbe8fcb13f31e6b5dae213e9bdd63d3307c7b699718885b334c4f401"} Jun 08 18:16:54.513396 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:54.513313 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" podStartSLOduration=1.952359639 podStartE2EDuration="4.513289656s" totalImagesPullingTime="2.560930017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:16:54.510102911 +0000 UTC m=+571.606602382" watchObservedRunningTime="2026-06-08 18:16:54.513289656 +0000 UTC m=+571.609789127" Jun 08 18:16:55.334864 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:55.334841 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:55.339439 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:55.339418 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:55.492929 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:55.492895 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-698f967485-ttqvs" event={"ID":"2e0a7774-da9d-428a-94e8-604ca5e14446","Type":"ContainerStarted","Data":"0044f2f4475179ab1157ac72fc032ab86bdff89dd8dfb163f2f940c1befbae4f"} Jun 08 18:16:55.493308 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:55.493266 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:55.494287 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:55.494267 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795rx46p" Jun 08 18:16:55.515006 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:16:55.514914 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-698f967485-ttqvs" podStartSLOduration=1.773118519 podStartE2EDuration="4.51489934s" totalImagesPullingTime="2.741780821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:16:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:16:55.513557498 +0000 UTC m=+572.610056969" watchObservedRunningTime="2026-06-08 18:16:55.51489934 +0000 UTC m=+572.611398809" Jun 08 18:17:20.320427 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:20.320358 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:17:20.418536 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:20.418500 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:17:20.438149 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:20.438115 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-287z6"] Jun 08 18:17:20.441548 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:20.441521 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-287z6" Jun 08 18:17:20.444181 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:20.444158 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 18:17:20.444302 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:20.444200 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 18:17:20.445353 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:20.445321 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-ptdgl\"" Jun 08 18:17:20.451685 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:20.451648 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-287z6"] Jun 08 18:17:20.485577 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:20.485542 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:17:20.582758 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:20.582676 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42jhl\" (UniqueName: \"kubernetes.io/projected/95d5e65d-ee5e-4962-85dd-e4586e3979ce-kube-api-access-42jhl\") pod \"kuadrant-operator-catalog-287z6\" (UID: \"95d5e65d-ee5e-4962-85dd-e4586e3979ce\") " pod="kuadrant-system/kuadrant-operator-catalog-287z6" Jun 08 18:17:20.683716 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:20.683681 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42jhl\" (UniqueName: \"kubernetes.io/projected/95d5e65d-ee5e-4962-85dd-e4586e3979ce-kube-api-access-42jhl\") pod \"kuadrant-operator-catalog-287z6\" (UID: \"95d5e65d-ee5e-4962-85dd-e4586e3979ce\") " pod="kuadrant-system/kuadrant-operator-catalog-287z6" Jun 08 18:17:20.692180 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:20.692152 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42jhl\" (UniqueName: \"kubernetes.io/projected/95d5e65d-ee5e-4962-85dd-e4586e3979ce-kube-api-access-42jhl\") pod \"kuadrant-operator-catalog-287z6\" (UID: \"95d5e65d-ee5e-4962-85dd-e4586e3979ce\") " pod="kuadrant-system/kuadrant-operator-catalog-287z6" Jun 08 18:17:20.754052 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:20.754015 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-287z6" Jun 08 18:17:20.808839 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:20.808806 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-287z6"] Jun 08 18:17:20.884626 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:20.884590 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-287z6"] Jun 08 18:17:20.887258 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:17:20.887230 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95d5e65d_ee5e_4962_85dd_e4586e3979ce.slice/crio-74143b5068deb030c6e939ac9a164e2104cb4d2a87998857a5007d690760fec0 WatchSource:0}: Error finding container 74143b5068deb030c6e939ac9a164e2104cb4d2a87998857a5007d690760fec0: Status 404 returned error can't find the container with id 74143b5068deb030c6e939ac9a164e2104cb4d2a87998857a5007d690760fec0 Jun 08 18:17:21.018824 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:21.018791 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qcvjn"] Jun 08 18:17:21.023460 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:21.023438 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qcvjn" Jun 08 18:17:21.030157 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:21.030130 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qcvjn"] Jun 08 18:17:21.188418 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:21.188308 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdcr2\" (UniqueName: \"kubernetes.io/projected/5456004e-5dfe-4c10-a8cd-b66d164bb592-kube-api-access-rdcr2\") pod \"kuadrant-operator-catalog-qcvjn\" (UID: \"5456004e-5dfe-4c10-a8cd-b66d164bb592\") " pod="kuadrant-system/kuadrant-operator-catalog-qcvjn" Jun 08 18:17:21.289101 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:21.289061 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdcr2\" (UniqueName: \"kubernetes.io/projected/5456004e-5dfe-4c10-a8cd-b66d164bb592-kube-api-access-rdcr2\") pod \"kuadrant-operator-catalog-qcvjn\" (UID: \"5456004e-5dfe-4c10-a8cd-b66d164bb592\") " pod="kuadrant-system/kuadrant-operator-catalog-qcvjn" Jun 08 18:17:21.297526 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:21.297505 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdcr2\" (UniqueName: \"kubernetes.io/projected/5456004e-5dfe-4c10-a8cd-b66d164bb592-kube-api-access-rdcr2\") pod \"kuadrant-operator-catalog-qcvjn\" (UID: \"5456004e-5dfe-4c10-a8cd-b66d164bb592\") " pod="kuadrant-system/kuadrant-operator-catalog-qcvjn" Jun 08 18:17:21.333994 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:21.333962 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-qcvjn" Jun 08 18:17:21.464113 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:21.464088 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-qcvjn"] Jun 08 18:17:21.466286 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:17:21.466258 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5456004e_5dfe_4c10_a8cd_b66d164bb592.slice/crio-f91dc274c5d003ecd2c488d1dcbe2b7f47cd8fa82595a3029d7621753a4d2f82 WatchSource:0}: Error finding container f91dc274c5d003ecd2c488d1dcbe2b7f47cd8fa82595a3029d7621753a4d2f82: Status 404 returned error can't find the container with id f91dc274c5d003ecd2c488d1dcbe2b7f47cd8fa82595a3029d7621753a4d2f82 Jun 08 18:17:21.624914 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:21.624875 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qcvjn" event={"ID":"5456004e-5dfe-4c10-a8cd-b66d164bb592","Type":"ContainerStarted","Data":"f91dc274c5d003ecd2c488d1dcbe2b7f47cd8fa82595a3029d7621753a4d2f82"} Jun 08 18:17:21.626189 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:21.626162 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-287z6" event={"ID":"95d5e65d-ee5e-4962-85dd-e4586e3979ce","Type":"ContainerStarted","Data":"74143b5068deb030c6e939ac9a164e2104cb4d2a87998857a5007d690760fec0"} Jun 08 18:17:23.409826 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:23.409798 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb7h4_b362d30f-bd8d-4a56-ae18-f05ebf4edb01/ovn-acl-logging/0.log" Jun 08 18:17:23.410303 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:23.410036 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb7h4_b362d30f-bd8d-4a56-ae18-f05ebf4edb01/ovn-acl-logging/0.log" Jun 08 18:17:23.641305 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:23.641261 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-287z6" event={"ID":"95d5e65d-ee5e-4962-85dd-e4586e3979ce","Type":"ContainerStarted","Data":"4ade98cb841abe6335177dbfa462d48bbf482bee874c358dd8e2240b11b98850"} Jun 08 18:17:23.641511 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:23.641294 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-287z6" podUID="95d5e65d-ee5e-4962-85dd-e4586e3979ce" containerName="registry-server" containerID="cri-o://4ade98cb841abe6335177dbfa462d48bbf482bee874c358dd8e2240b11b98850" gracePeriod=2 Jun 08 18:17:23.642981 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:23.642945 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-qcvjn" event={"ID":"5456004e-5dfe-4c10-a8cd-b66d164bb592","Type":"ContainerStarted","Data":"054f885377d88d66e6eaace866c11db6d929d72c51ed132f44e934c96a8c2124"} Jun 08 18:17:23.656765 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:23.656719 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-287z6" podStartSLOduration=1.088563762 podStartE2EDuration="3.656705201s" totalImagesPullingTime="2.568141439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:17:23.655931734 +0000 UTC m=+600.752431229" watchObservedRunningTime="2026-06-08 18:17:23.656705201 +0000 UTC m=+600.753204671" Jun 08 18:17:23.671678 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:23.671600 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-qcvjn" podStartSLOduration=0.686541331 podStartE2EDuration="2.671586689s" totalImagesPullingTime="1.985045358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:17:23.670652689 +0000 UTC m=+600.767152150" watchObservedRunningTime="2026-06-08 18:17:23.671586689 +0000 UTC m=+600.768086160" Jun 08 18:17:23.886367 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:23.886344 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-287z6" Jun 08 18:17:24.015920 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:24.015884 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42jhl\" (UniqueName: \"kubernetes.io/projected/95d5e65d-ee5e-4962-85dd-e4586e3979ce-kube-api-access-42jhl\") pod \"95d5e65d-ee5e-4962-85dd-e4586e3979ce\" (UID: \"95d5e65d-ee5e-4962-85dd-e4586e3979ce\") " Jun 08 18:17:24.017995 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:24.017968 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95d5e65d-ee5e-4962-85dd-e4586e3979ce-kube-api-access-42jhl" (OuterVolumeSpecName: "kube-api-access-42jhl") pod "95d5e65d-ee5e-4962-85dd-e4586e3979ce" (UID: "95d5e65d-ee5e-4962-85dd-e4586e3979ce"). InnerVolumeSpecName "kube-api-access-42jhl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:17:24.116759 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:24.116726 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42jhl\" (UniqueName: \"kubernetes.io/projected/95d5e65d-ee5e-4962-85dd-e4586e3979ce-kube-api-access-42jhl\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:17:24.649196 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:24.649166 2556 generic.go:356] "Generic (PLEG): container finished" podID="95d5e65d-ee5e-4962-85dd-e4586e3979ce" containerID="4ade98cb841abe6335177dbfa462d48bbf482bee874c358dd8e2240b11b98850" exitCode=0 Jun 08 18:17:24.649706 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:24.649206 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-287z6" Jun 08 18:17:24.649706 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:24.649251 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-287z6" event={"ID":"95d5e65d-ee5e-4962-85dd-e4586e3979ce","Type":"ContainerDied","Data":"4ade98cb841abe6335177dbfa462d48bbf482bee874c358dd8e2240b11b98850"} Jun 08 18:17:24.649706 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:24.649300 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-287z6" event={"ID":"95d5e65d-ee5e-4962-85dd-e4586e3979ce","Type":"ContainerDied","Data":"74143b5068deb030c6e939ac9a164e2104cb4d2a87998857a5007d690760fec0"} Jun 08 18:17:24.649706 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:24.649320 2556 scope.go:117] "RemoveContainer" containerID="4ade98cb841abe6335177dbfa462d48bbf482bee874c358dd8e2240b11b98850" Jun 08 18:17:24.658616 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:24.658598 2556 scope.go:117] "RemoveContainer" containerID="4ade98cb841abe6335177dbfa462d48bbf482bee874c358dd8e2240b11b98850" Jun 08 18:17:24.658855 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:17:24.658836 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ade98cb841abe6335177dbfa462d48bbf482bee874c358dd8e2240b11b98850\": container with ID starting with 4ade98cb841abe6335177dbfa462d48bbf482bee874c358dd8e2240b11b98850 not found: ID does not exist" containerID="4ade98cb841abe6335177dbfa462d48bbf482bee874c358dd8e2240b11b98850" Jun 08 18:17:24.658901 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:24.658864 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ade98cb841abe6335177dbfa462d48bbf482bee874c358dd8e2240b11b98850"} err="failed to get container status \"4ade98cb841abe6335177dbfa462d48bbf482bee874c358dd8e2240b11b98850\": rpc error: code = NotFound desc = could not find container \"4ade98cb841abe6335177dbfa462d48bbf482bee874c358dd8e2240b11b98850\": container with ID starting with 4ade98cb841abe6335177dbfa462d48bbf482bee874c358dd8e2240b11b98850 not found: ID does not exist" Jun 08 18:17:24.670256 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:24.670233 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-287z6"] Jun 08 18:17:24.675952 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:24.675931 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-287z6"] Jun 08 18:17:25.400217 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:25.400185 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95d5e65d-ee5e-4962-85dd-e4586e3979ce" path="/var/lib/kubelet/pods/95d5e65d-ee5e-4962-85dd-e4586e3979ce/volumes" Jun 08 18:17:31.334117 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:31.334078 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-qcvjn" Jun 08 18:17:31.334560 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:31.334143 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-qcvjn" Jun 08 18:17:31.356155 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:31.356130 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-qcvjn" Jun 08 18:17:31.707476 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:31.707396 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-qcvjn" Jun 08 18:17:35.402750 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.402713 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:17:35.437913 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.437878 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb"] Jun 08 18:17:35.438217 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.438204 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95d5e65d-ee5e-4962-85dd-e4586e3979ce" containerName="registry-server" Jun 08 18:17:35.438266 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.438218 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="95d5e65d-ee5e-4962-85dd-e4586e3979ce" containerName="registry-server" Jun 08 18:17:35.438308 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.438267 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="95d5e65d-ee5e-4962-85dd-e4586e3979ce" containerName="registry-server" Jun 08 18:17:35.449604 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.449579 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" Jun 08 18:17:35.449904 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.449875 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb"] Jun 08 18:17:35.452921 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.452895 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6cwmd\"" Jun 08 18:17:35.503772 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.503734 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb\" (UID: \"0d395ca2-dbad-45f0-b7b9-6824e71bdea4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" Jun 08 18:17:35.503936 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.503851 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcjz2\" (UniqueName: \"kubernetes.io/projected/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-kube-api-access-xcjz2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb\" (UID: \"0d395ca2-dbad-45f0-b7b9-6824e71bdea4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" Jun 08 18:17:35.503936 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.503888 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb\" (UID: \"0d395ca2-dbad-45f0-b7b9-6824e71bdea4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" Jun 08 18:17:35.604738 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.604685 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcjz2\" (UniqueName: \"kubernetes.io/projected/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-kube-api-access-xcjz2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb\" (UID: \"0d395ca2-dbad-45f0-b7b9-6824e71bdea4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" Jun 08 18:17:35.604738 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.604742 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb\" (UID: \"0d395ca2-dbad-45f0-b7b9-6824e71bdea4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" Jun 08 18:17:35.604967 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.604763 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb\" (UID: \"0d395ca2-dbad-45f0-b7b9-6824e71bdea4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" Jun 08 18:17:35.605156 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.605137 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb\" (UID: \"0d395ca2-dbad-45f0-b7b9-6824e71bdea4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" Jun 08 18:17:35.605196 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.605164 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb\" (UID: \"0d395ca2-dbad-45f0-b7b9-6824e71bdea4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" Jun 08 18:17:35.612880 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.612849 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcjz2\" (UniqueName: \"kubernetes.io/projected/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-kube-api-access-xcjz2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb\" (UID: \"0d395ca2-dbad-45f0-b7b9-6824e71bdea4\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" Jun 08 18:17:35.759607 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.759572 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" Jun 08 18:17:35.890558 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:35.890534 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb"] Jun 08 18:17:35.892669 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:17:35.892637 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d395ca2_dbad_45f0_b7b9_6824e71bdea4.slice/crio-866d931a7a6075defd5f81221de71cf369ea9ee8c96a8beccef224e1904c6a73 WatchSource:0}: Error finding container 866d931a7a6075defd5f81221de71cf369ea9ee8c96a8beccef224e1904c6a73: Status 404 returned error can't find the container with id 866d931a7a6075defd5f81221de71cf369ea9ee8c96a8beccef224e1904c6a73 Jun 08 18:17:36.040593 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.040520 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6"] Jun 08 18:17:36.043977 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.043962 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" Jun 08 18:17:36.054178 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.054152 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6"] Jun 08 18:17:36.108159 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.108128 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rbdx\" (UniqueName: \"kubernetes.io/projected/8e51df07-bd72-4297-ad99-890f2c0bbaf9-kube-api-access-8rbdx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6\" (UID: \"8e51df07-bd72-4297-ad99-890f2c0bbaf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" Jun 08 18:17:36.108304 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.108172 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e51df07-bd72-4297-ad99-890f2c0bbaf9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6\" (UID: \"8e51df07-bd72-4297-ad99-890f2c0bbaf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" Jun 08 18:17:36.108304 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.108200 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e51df07-bd72-4297-ad99-890f2c0bbaf9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6\" (UID: \"8e51df07-bd72-4297-ad99-890f2c0bbaf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" Jun 08 18:17:36.208949 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.208912 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e51df07-bd72-4297-ad99-890f2c0bbaf9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6\" (UID: \"8e51df07-bd72-4297-ad99-890f2c0bbaf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" Jun 08 18:17:36.209191 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.209011 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rbdx\" (UniqueName: \"kubernetes.io/projected/8e51df07-bd72-4297-ad99-890f2c0bbaf9-kube-api-access-8rbdx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6\" (UID: \"8e51df07-bd72-4297-ad99-890f2c0bbaf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" Jun 08 18:17:36.209191 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.209056 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e51df07-bd72-4297-ad99-890f2c0bbaf9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6\" (UID: \"8e51df07-bd72-4297-ad99-890f2c0bbaf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" Jun 08 18:17:36.209423 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.209368 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e51df07-bd72-4297-ad99-890f2c0bbaf9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6\" (UID: \"8e51df07-bd72-4297-ad99-890f2c0bbaf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" Jun 08 18:17:36.209478 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.209410 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e51df07-bd72-4297-ad99-890f2c0bbaf9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6\" (UID: \"8e51df07-bd72-4297-ad99-890f2c0bbaf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" Jun 08 18:17:36.217334 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.217302 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rbdx\" (UniqueName: \"kubernetes.io/projected/8e51df07-bd72-4297-ad99-890f2c0bbaf9-kube-api-access-8rbdx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6\" (UID: \"8e51df07-bd72-4297-ad99-890f2c0bbaf9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" Jun 08 18:17:36.381358 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.381270 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" Jun 08 18:17:36.510359 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.510329 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6"] Jun 08 18:17:36.511840 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:17:36.511812 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e51df07_bd72_4297_ad99_890f2c0bbaf9.slice/crio-606a48ff80f131b18b64e721ce1649907db00f18aa618121f65b7abab4b4bb65 WatchSource:0}: Error finding container 606a48ff80f131b18b64e721ce1649907db00f18aa618121f65b7abab4b4bb65: Status 404 returned error can't find the container with id 606a48ff80f131b18b64e721ce1649907db00f18aa618121f65b7abab4b4bb65 Jun 08 18:17:36.641689 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.641629 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q"] Jun 08 18:17:36.645072 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.645055 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" Jun 08 18:17:36.653949 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.653924 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q"] Jun 08 18:17:36.711170 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.711136 2556 generic.go:356] "Generic (PLEG): container finished" podID="0d395ca2-dbad-45f0-b7b9-6824e71bdea4" containerID="cd8281923d2c111dd1b2f1730f47002ff8e58b891e2fc87d667350b8f809b0bc" exitCode=0 Jun 08 18:17:36.711345 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.711185 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" event={"ID":"0d395ca2-dbad-45f0-b7b9-6824e71bdea4","Type":"ContainerDied","Data":"cd8281923d2c111dd1b2f1730f47002ff8e58b891e2fc87d667350b8f809b0bc"} Jun 08 18:17:36.711345 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.711245 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" event={"ID":"0d395ca2-dbad-45f0-b7b9-6824e71bdea4","Type":"ContainerStarted","Data":"866d931a7a6075defd5f81221de71cf369ea9ee8c96a8beccef224e1904c6a73"} Jun 08 18:17:36.711751 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.711733 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 18:17:36.712855 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.712835 2556 generic.go:356] "Generic (PLEG): container finished" podID="8e51df07-bd72-4297-ad99-890f2c0bbaf9" containerID="1a742de2e43b0fa5787fa2652cd906e8f7ce31dc719a0a340fcbc1ac5123d082" exitCode=0 Jun 08 18:17:36.712945 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.712918 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" event={"ID":"8e51df07-bd72-4297-ad99-890f2c0bbaf9","Type":"ContainerDied","Data":"1a742de2e43b0fa5787fa2652cd906e8f7ce31dc719a0a340fcbc1ac5123d082"} Jun 08 18:17:36.712987 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.712963 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" event={"ID":"8e51df07-bd72-4297-ad99-890f2c0bbaf9","Type":"ContainerStarted","Data":"606a48ff80f131b18b64e721ce1649907db00f18aa618121f65b7abab4b4bb65"} Jun 08 18:17:36.713637 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.713617 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q\" (UID: \"fd1f5632-a42c-4973-8800-2b4b0a9b7f80\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" Jun 08 18:17:36.713744 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.713690 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q\" (UID: \"fd1f5632-a42c-4973-8800-2b4b0a9b7f80\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" Jun 08 18:17:36.713744 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.713723 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stl58\" (UniqueName: \"kubernetes.io/projected/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-kube-api-access-stl58\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q\" (UID: \"fd1f5632-a42c-4973-8800-2b4b0a9b7f80\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" Jun 08 18:17:36.814187 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.814151 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q\" (UID: \"fd1f5632-a42c-4973-8800-2b4b0a9b7f80\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" Jun 08 18:17:36.814401 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.814354 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q\" (UID: \"fd1f5632-a42c-4973-8800-2b4b0a9b7f80\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" Jun 08 18:17:36.814488 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.814421 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stl58\" (UniqueName: \"kubernetes.io/projected/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-kube-api-access-stl58\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q\" (UID: \"fd1f5632-a42c-4973-8800-2b4b0a9b7f80\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" Jun 08 18:17:36.814559 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.814521 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q\" (UID: \"fd1f5632-a42c-4973-8800-2b4b0a9b7f80\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" Jun 08 18:17:36.814741 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.814720 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q\" (UID: \"fd1f5632-a42c-4973-8800-2b4b0a9b7f80\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" Jun 08 18:17:36.823291 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.823273 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stl58\" (UniqueName: \"kubernetes.io/projected/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-kube-api-access-stl58\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q\" (UID: \"fd1f5632-a42c-4973-8800-2b4b0a9b7f80\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" Jun 08 18:17:36.993437 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:36.993399 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" Jun 08 18:17:37.037249 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.037220 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd"] Jun 08 18:17:37.041942 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.041911 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" Jun 08 18:17:37.054307 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.052814 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd"] Jun 08 18:17:37.117897 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.117858 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0add1f90-e8d3-4d81-8731-d49f638040ab-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd\" (UID: \"0add1f90-e8d3-4d81-8731-d49f638040ab\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" Jun 08 18:17:37.118075 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.117921 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6lg2\" (UniqueName: \"kubernetes.io/projected/0add1f90-e8d3-4d81-8731-d49f638040ab-kube-api-access-p6lg2\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd\" (UID: \"0add1f90-e8d3-4d81-8731-d49f638040ab\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" Jun 08 18:17:37.118075 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.118009 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0add1f90-e8d3-4d81-8731-d49f638040ab-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd\" (UID: \"0add1f90-e8d3-4d81-8731-d49f638040ab\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" Jun 08 18:17:37.129729 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.129704 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q"] Jun 08 18:17:37.131700 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:17:37.131667 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1f5632_a42c_4973_8800_2b4b0a9b7f80.slice/crio-d66347645eac71c4e27be427f75e862e14e0774daa691c68ddf5ceb08c80a9f7 WatchSource:0}: Error finding container d66347645eac71c4e27be427f75e862e14e0774daa691c68ddf5ceb08c80a9f7: Status 404 returned error can't find the container with id d66347645eac71c4e27be427f75e862e14e0774daa691c68ddf5ceb08c80a9f7 Jun 08 18:17:37.219221 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.219182 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0add1f90-e8d3-4d81-8731-d49f638040ab-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd\" (UID: \"0add1f90-e8d3-4d81-8731-d49f638040ab\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" Jun 08 18:17:37.219409 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.219247 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0add1f90-e8d3-4d81-8731-d49f638040ab-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd\" (UID: \"0add1f90-e8d3-4d81-8731-d49f638040ab\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" Jun 08 18:17:37.219409 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.219297 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6lg2\" (UniqueName: \"kubernetes.io/projected/0add1f90-e8d3-4d81-8731-d49f638040ab-kube-api-access-p6lg2\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd\" (UID: \"0add1f90-e8d3-4d81-8731-d49f638040ab\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" Jun 08 18:17:37.219712 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.219685 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0add1f90-e8d3-4d81-8731-d49f638040ab-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd\" (UID: \"0add1f90-e8d3-4d81-8731-d49f638040ab\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" Jun 08 18:17:37.219751 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.219694 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0add1f90-e8d3-4d81-8731-d49f638040ab-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd\" (UID: \"0add1f90-e8d3-4d81-8731-d49f638040ab\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" Jun 08 18:17:37.233041 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.233020 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6lg2\" (UniqueName: \"kubernetes.io/projected/0add1f90-e8d3-4d81-8731-d49f638040ab-kube-api-access-p6lg2\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd\" (UID: \"0add1f90-e8d3-4d81-8731-d49f638040ab\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" Jun 08 18:17:37.356176 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.356102 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" Jun 08 18:17:37.578999 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.578975 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd"] Jun 08 18:17:37.583320 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:17:37.583290 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0add1f90_e8d3_4d81_8731_d49f638040ab.slice/crio-18bcb8429eb099b39a118ef73e7cea5682f8ddfbb3093ed0ebea8b5b0661c3c5 WatchSource:0}: Error finding container 18bcb8429eb099b39a118ef73e7cea5682f8ddfbb3093ed0ebea8b5b0661c3c5: Status 404 returned error can't find the container with id 18bcb8429eb099b39a118ef73e7cea5682f8ddfbb3093ed0ebea8b5b0661c3c5 Jun 08 18:17:37.720918 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.720880 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" event={"ID":"0add1f90-e8d3-4d81-8731-d49f638040ab","Type":"ContainerStarted","Data":"48a9a22c1622c583d9672dd56c5a0547f8c3e53f4bf6e8132661bd84f84a490a"} Jun 08 18:17:37.721069 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.720942 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" event={"ID":"0add1f90-e8d3-4d81-8731-d49f638040ab","Type":"ContainerStarted","Data":"18bcb8429eb099b39a118ef73e7cea5682f8ddfbb3093ed0ebea8b5b0661c3c5"} Jun 08 18:17:37.722584 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.722555 2556 generic.go:356] "Generic (PLEG): container finished" podID="fd1f5632-a42c-4973-8800-2b4b0a9b7f80" containerID="6ce02c7ba288c63cd6dedf162ab58f0a3766194c32d05afce323558b72d17959" exitCode=0 Jun 08 18:17:37.722726 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.722643 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" event={"ID":"fd1f5632-a42c-4973-8800-2b4b0a9b7f80","Type":"ContainerDied","Data":"6ce02c7ba288c63cd6dedf162ab58f0a3766194c32d05afce323558b72d17959"} Jun 08 18:17:37.722726 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.722693 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" event={"ID":"fd1f5632-a42c-4973-8800-2b4b0a9b7f80","Type":"ContainerStarted","Data":"d66347645eac71c4e27be427f75e862e14e0774daa691c68ddf5ceb08c80a9f7"} Jun 08 18:17:37.724980 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.724958 2556 generic.go:356] "Generic (PLEG): container finished" podID="0d395ca2-dbad-45f0-b7b9-6824e71bdea4" containerID="9071708ddce17a517e6f7fd8119a19f57c791a867ac735cbc33caa9eceb255f5" exitCode=0 Jun 08 18:17:37.725111 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.725090 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" event={"ID":"0d395ca2-dbad-45f0-b7b9-6824e71bdea4","Type":"ContainerDied","Data":"9071708ddce17a517e6f7fd8119a19f57c791a867ac735cbc33caa9eceb255f5"} Jun 08 18:17:37.727108 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.727080 2556 generic.go:356] "Generic (PLEG): container finished" podID="8e51df07-bd72-4297-ad99-890f2c0bbaf9" containerID="3ea63d24b97200730cd842cd3dda9f61bc0460f62cc64f0c228755af9ddf84c9" exitCode=0 Jun 08 18:17:37.727206 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:37.727140 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" event={"ID":"8e51df07-bd72-4297-ad99-890f2c0bbaf9","Type":"ContainerDied","Data":"3ea63d24b97200730cd842cd3dda9f61bc0460f62cc64f0c228755af9ddf84c9"} Jun 08 18:17:38.734677 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:38.734641 2556 generic.go:356] "Generic (PLEG): container finished" podID="0add1f90-e8d3-4d81-8731-d49f638040ab" containerID="48a9a22c1622c583d9672dd56c5a0547f8c3e53f4bf6e8132661bd84f84a490a" exitCode=0 Jun 08 18:17:38.735122 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:38.734714 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" event={"ID":"0add1f90-e8d3-4d81-8731-d49f638040ab","Type":"ContainerDied","Data":"48a9a22c1622c583d9672dd56c5a0547f8c3e53f4bf6e8132661bd84f84a490a"} Jun 08 18:17:38.736885 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:38.736861 2556 generic.go:356] "Generic (PLEG): container finished" podID="fd1f5632-a42c-4973-8800-2b4b0a9b7f80" containerID="5104300f4e032321d540d9e8e61c0263407fefbfe89996e390e7498374153f6d" exitCode=0 Jun 08 18:17:38.737005 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:38.736951 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" event={"ID":"fd1f5632-a42c-4973-8800-2b4b0a9b7f80","Type":"ContainerDied","Data":"5104300f4e032321d540d9e8e61c0263407fefbfe89996e390e7498374153f6d"} Jun 08 18:17:38.739214 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:38.739193 2556 generic.go:356] "Generic (PLEG): container finished" podID="0d395ca2-dbad-45f0-b7b9-6824e71bdea4" containerID="8d2df010261078d08b40c77a58b849991a4e03b971795f879ebedc6bbe9f6079" exitCode=0 Jun 08 18:17:38.739316 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:38.739271 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" event={"ID":"0d395ca2-dbad-45f0-b7b9-6824e71bdea4","Type":"ContainerDied","Data":"8d2df010261078d08b40c77a58b849991a4e03b971795f879ebedc6bbe9f6079"} Jun 08 18:17:38.741188 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:38.741168 2556 generic.go:356] "Generic (PLEG): container finished" podID="8e51df07-bd72-4297-ad99-890f2c0bbaf9" containerID="b570c2b79658b7fe337a6ed3e25a83b3f201b1804c1b94fbdf4c4da78b30615e" exitCode=0 Jun 08 18:17:38.741324 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:38.741217 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" event={"ID":"8e51df07-bd72-4297-ad99-890f2c0bbaf9","Type":"ContainerDied","Data":"b570c2b79658b7fe337a6ed3e25a83b3f201b1804c1b94fbdf4c4da78b30615e"} Jun 08 18:17:39.748055 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.748024 2556 generic.go:356] "Generic (PLEG): container finished" podID="0add1f90-e8d3-4d81-8731-d49f638040ab" containerID="b0924ae58ad1b2614bf23ea42a71b08ec0856ecf32de1a67e18c8b7989cd267d" exitCode=0 Jun 08 18:17:39.748498 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.748098 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" event={"ID":"0add1f90-e8d3-4d81-8731-d49f638040ab","Type":"ContainerDied","Data":"b0924ae58ad1b2614bf23ea42a71b08ec0856ecf32de1a67e18c8b7989cd267d"} Jun 08 18:17:39.750342 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.750318 2556 generic.go:356] "Generic (PLEG): container finished" podID="fd1f5632-a42c-4973-8800-2b4b0a9b7f80" containerID="00a42b45fcfd1b9d394057e45f6c94944d662c4f0dadf5ccc54e0c3fb72becb3" exitCode=0 Jun 08 18:17:39.750487 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.750401 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" event={"ID":"fd1f5632-a42c-4973-8800-2b4b0a9b7f80","Type":"ContainerDied","Data":"00a42b45fcfd1b9d394057e45f6c94944d662c4f0dadf5ccc54e0c3fb72becb3"} Jun 08 18:17:39.892006 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.891975 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" Jun 08 18:17:39.919136 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.919110 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" Jun 08 18:17:39.941894 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.941866 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-bundle\") pod \"0d395ca2-dbad-45f0-b7b9-6824e71bdea4\" (UID: \"0d395ca2-dbad-45f0-b7b9-6824e71bdea4\") " Jun 08 18:17:39.942071 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.941945 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e51df07-bd72-4297-ad99-890f2c0bbaf9-util\") pod \"8e51df07-bd72-4297-ad99-890f2c0bbaf9\" (UID: \"8e51df07-bd72-4297-ad99-890f2c0bbaf9\") " Jun 08 18:17:39.942071 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.941996 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e51df07-bd72-4297-ad99-890f2c0bbaf9-bundle\") pod \"8e51df07-bd72-4297-ad99-890f2c0bbaf9\" (UID: \"8e51df07-bd72-4297-ad99-890f2c0bbaf9\") " Jun 08 18:17:39.942071 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.942028 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcjz2\" (UniqueName: \"kubernetes.io/projected/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-kube-api-access-xcjz2\") pod \"0d395ca2-dbad-45f0-b7b9-6824e71bdea4\" (UID: \"0d395ca2-dbad-45f0-b7b9-6824e71bdea4\") " Jun 08 18:17:39.942235 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.942091 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rbdx\" (UniqueName: \"kubernetes.io/projected/8e51df07-bd72-4297-ad99-890f2c0bbaf9-kube-api-access-8rbdx\") pod \"8e51df07-bd72-4297-ad99-890f2c0bbaf9\" (UID: \"8e51df07-bd72-4297-ad99-890f2c0bbaf9\") " Jun 08 18:17:39.942235 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.942122 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-util\") pod \"0d395ca2-dbad-45f0-b7b9-6824e71bdea4\" (UID: \"0d395ca2-dbad-45f0-b7b9-6824e71bdea4\") " Jun 08 18:17:39.943731 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.943622 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-bundle" (OuterVolumeSpecName: "bundle") pod "0d395ca2-dbad-45f0-b7b9-6824e71bdea4" (UID: "0d395ca2-dbad-45f0-b7b9-6824e71bdea4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:17:39.943731 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.943669 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e51df07-bd72-4297-ad99-890f2c0bbaf9-bundle" (OuterVolumeSpecName: "bundle") pod "8e51df07-bd72-4297-ad99-890f2c0bbaf9" (UID: "8e51df07-bd72-4297-ad99-890f2c0bbaf9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:17:39.944582 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.944550 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e51df07-bd72-4297-ad99-890f2c0bbaf9-kube-api-access-8rbdx" (OuterVolumeSpecName: "kube-api-access-8rbdx") pod "8e51df07-bd72-4297-ad99-890f2c0bbaf9" (UID: "8e51df07-bd72-4297-ad99-890f2c0bbaf9"). InnerVolumeSpecName "kube-api-access-8rbdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:17:39.945052 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.945011 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-kube-api-access-xcjz2" (OuterVolumeSpecName: "kube-api-access-xcjz2") pod "0d395ca2-dbad-45f0-b7b9-6824e71bdea4" (UID: "0d395ca2-dbad-45f0-b7b9-6824e71bdea4"). InnerVolumeSpecName "kube-api-access-xcjz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:17:39.948790 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.948762 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e51df07-bd72-4297-ad99-890f2c0bbaf9-util" (OuterVolumeSpecName: "util") pod "8e51df07-bd72-4297-ad99-890f2c0bbaf9" (UID: "8e51df07-bd72-4297-ad99-890f2c0bbaf9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:17:39.950475 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:39.950452 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-util" (OuterVolumeSpecName: "util") pod "0d395ca2-dbad-45f0-b7b9-6824e71bdea4" (UID: "0d395ca2-dbad-45f0-b7b9-6824e71bdea4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:17:40.043488 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.043401 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rbdx\" (UniqueName: \"kubernetes.io/projected/8e51df07-bd72-4297-ad99-890f2c0bbaf9-kube-api-access-8rbdx\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:17:40.043488 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.043429 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-util\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:17:40.043488 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.043439 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-bundle\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:17:40.043488 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.043446 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8e51df07-bd72-4297-ad99-890f2c0bbaf9-util\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:17:40.043488 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.043453 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8e51df07-bd72-4297-ad99-890f2c0bbaf9-bundle\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:17:40.043488 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.043461 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcjz2\" (UniqueName: \"kubernetes.io/projected/0d395ca2-dbad-45f0-b7b9-6824e71bdea4-kube-api-access-xcjz2\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:17:40.757640 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.757611 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" Jun 08 18:17:40.757640 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.757622 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb" event={"ID":"0d395ca2-dbad-45f0-b7b9-6824e71bdea4","Type":"ContainerDied","Data":"866d931a7a6075defd5f81221de71cf369ea9ee8c96a8beccef224e1904c6a73"} Jun 08 18:17:40.758069 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.757669 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="866d931a7a6075defd5f81221de71cf369ea9ee8c96a8beccef224e1904c6a73" Jun 08 18:17:40.759507 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.759481 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" Jun 08 18:17:40.759624 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.759509 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6" event={"ID":"8e51df07-bd72-4297-ad99-890f2c0bbaf9","Type":"ContainerDied","Data":"606a48ff80f131b18b64e721ce1649907db00f18aa618121f65b7abab4b4bb65"} Jun 08 18:17:40.759624 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.759550 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="606a48ff80f131b18b64e721ce1649907db00f18aa618121f65b7abab4b4bb65" Jun 08 18:17:40.761754 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.761735 2556 generic.go:356] "Generic (PLEG): container finished" podID="0add1f90-e8d3-4d81-8731-d49f638040ab" containerID="fe70fe2430c0605a18b95770f85a8acb4b521b3a54daf4a78bd87936d1bbce06" exitCode=0 Jun 08 18:17:40.761863 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.761809 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" event={"ID":"0add1f90-e8d3-4d81-8731-d49f638040ab","Type":"ContainerDied","Data":"fe70fe2430c0605a18b95770f85a8acb4b521b3a54daf4a78bd87936d1bbce06"} Jun 08 18:17:40.894313 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.894246 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" Jun 08 18:17:40.950786 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.950754 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-bundle\") pod \"fd1f5632-a42c-4973-8800-2b4b0a9b7f80\" (UID: \"fd1f5632-a42c-4973-8800-2b4b0a9b7f80\") " Jun 08 18:17:40.950979 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.950802 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-util\") pod \"fd1f5632-a42c-4973-8800-2b4b0a9b7f80\" (UID: \"fd1f5632-a42c-4973-8800-2b4b0a9b7f80\") " Jun 08 18:17:40.950979 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.950829 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stl58\" (UniqueName: \"kubernetes.io/projected/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-kube-api-access-stl58\") pod \"fd1f5632-a42c-4973-8800-2b4b0a9b7f80\" (UID: \"fd1f5632-a42c-4973-8800-2b4b0a9b7f80\") " Jun 08 18:17:40.951295 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.951264 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-bundle" (OuterVolumeSpecName: "bundle") pod "fd1f5632-a42c-4973-8800-2b4b0a9b7f80" (UID: "fd1f5632-a42c-4973-8800-2b4b0a9b7f80"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:17:40.952979 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.952946 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-kube-api-access-stl58" (OuterVolumeSpecName: "kube-api-access-stl58") pod "fd1f5632-a42c-4973-8800-2b4b0a9b7f80" (UID: "fd1f5632-a42c-4973-8800-2b4b0a9b7f80"). InnerVolumeSpecName "kube-api-access-stl58". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:17:40.956489 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:40.956465 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-util" (OuterVolumeSpecName: "util") pod "fd1f5632-a42c-4973-8800-2b4b0a9b7f80" (UID: "fd1f5632-a42c-4973-8800-2b4b0a9b7f80"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:17:41.051968 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:41.051925 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-bundle\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:17:41.051968 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:41.051959 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-util\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:17:41.051968 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:41.051968 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stl58\" (UniqueName: \"kubernetes.io/projected/fd1f5632-a42c-4973-8800-2b4b0a9b7f80-kube-api-access-stl58\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:17:41.769147 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:41.769115 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" Jun 08 18:17:41.769147 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:41.769127 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q" event={"ID":"fd1f5632-a42c-4973-8800-2b4b0a9b7f80","Type":"ContainerDied","Data":"d66347645eac71c4e27be427f75e862e14e0774daa691c68ddf5ceb08c80a9f7"} Jun 08 18:17:41.769692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:41.769172 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d66347645eac71c4e27be427f75e862e14e0774daa691c68ddf5ceb08c80a9f7" Jun 08 18:17:41.903317 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:41.903286 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" Jun 08 18:17:41.959890 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:41.959851 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0add1f90-e8d3-4d81-8731-d49f638040ab-util\") pod \"0add1f90-e8d3-4d81-8731-d49f638040ab\" (UID: \"0add1f90-e8d3-4d81-8731-d49f638040ab\") " Jun 08 18:17:41.960067 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:41.959910 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6lg2\" (UniqueName: \"kubernetes.io/projected/0add1f90-e8d3-4d81-8731-d49f638040ab-kube-api-access-p6lg2\") pod \"0add1f90-e8d3-4d81-8731-d49f638040ab\" (UID: \"0add1f90-e8d3-4d81-8731-d49f638040ab\") " Jun 08 18:17:41.960067 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:41.959939 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0add1f90-e8d3-4d81-8731-d49f638040ab-bundle\") pod \"0add1f90-e8d3-4d81-8731-d49f638040ab\" (UID: \"0add1f90-e8d3-4d81-8731-d49f638040ab\") " Jun 08 18:17:41.960595 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:41.960554 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0add1f90-e8d3-4d81-8731-d49f638040ab-bundle" (OuterVolumeSpecName: "bundle") pod "0add1f90-e8d3-4d81-8731-d49f638040ab" (UID: "0add1f90-e8d3-4d81-8731-d49f638040ab"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:17:41.962063 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:41.962034 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0add1f90-e8d3-4d81-8731-d49f638040ab-kube-api-access-p6lg2" (OuterVolumeSpecName: "kube-api-access-p6lg2") pod "0add1f90-e8d3-4d81-8731-d49f638040ab" (UID: "0add1f90-e8d3-4d81-8731-d49f638040ab"). InnerVolumeSpecName "kube-api-access-p6lg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:17:41.968594 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:41.968560 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0add1f90-e8d3-4d81-8731-d49f638040ab-util" (OuterVolumeSpecName: "util") pod "0add1f90-e8d3-4d81-8731-d49f638040ab" (UID: "0add1f90-e8d3-4d81-8731-d49f638040ab"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:17:42.061510 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:42.061418 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0add1f90-e8d3-4d81-8731-d49f638040ab-util\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:17:42.061510 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:42.061450 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6lg2\" (UniqueName: \"kubernetes.io/projected/0add1f90-e8d3-4d81-8731-d49f638040ab-kube-api-access-p6lg2\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:17:42.061510 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:42.061461 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0add1f90-e8d3-4d81-8731-d49f638040ab-bundle\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:17:42.775848 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:42.775774 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" Jun 08 18:17:42.775848 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:42.775804 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd" event={"ID":"0add1f90-e8d3-4d81-8731-d49f638040ab","Type":"ContainerDied","Data":"18bcb8429eb099b39a118ef73e7cea5682f8ddfbb3093ed0ebea8b5b0661c3c5"} Jun 08 18:17:42.776368 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:42.775849 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18bcb8429eb099b39a118ef73e7cea5682f8ddfbb3093ed0ebea8b5b0661c3c5" Jun 08 18:17:48.014080 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:48.014039 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:17:48.114499 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:48.114469 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:17:49.202913 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:49.202878 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:17:51.831056 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831015 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq"] Jun 08 18:17:51.831692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831518 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e51df07-bd72-4297-ad99-890f2c0bbaf9" containerName="pull" Jun 08 18:17:51.831692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831537 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e51df07-bd72-4297-ad99-890f2c0bbaf9" containerName="pull" Jun 08 18:17:51.831692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831547 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e51df07-bd72-4297-ad99-890f2c0bbaf9" containerName="extract" Jun 08 18:17:51.831692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831556 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e51df07-bd72-4297-ad99-890f2c0bbaf9" containerName="extract" Jun 08 18:17:51.831692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831569 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e51df07-bd72-4297-ad99-890f2c0bbaf9" containerName="util" Jun 08 18:17:51.831692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831578 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e51df07-bd72-4297-ad99-890f2c0bbaf9" containerName="util" Jun 08 18:17:51.831692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831593 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0add1f90-e8d3-4d81-8731-d49f638040ab" containerName="util" Jun 08 18:17:51.831692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831602 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0add1f90-e8d3-4d81-8731-d49f638040ab" containerName="util" Jun 08 18:17:51.831692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831616 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d395ca2-dbad-45f0-b7b9-6824e71bdea4" containerName="util" Jun 08 18:17:51.831692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831624 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d395ca2-dbad-45f0-b7b9-6824e71bdea4" containerName="util" Jun 08 18:17:51.831692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831649 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d395ca2-dbad-45f0-b7b9-6824e71bdea4" containerName="extract" Jun 08 18:17:51.831692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831657 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d395ca2-dbad-45f0-b7b9-6824e71bdea4" containerName="extract" Jun 08 18:17:51.831692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831666 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0add1f90-e8d3-4d81-8731-d49f638040ab" containerName="extract" Jun 08 18:17:51.831692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831675 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0add1f90-e8d3-4d81-8731-d49f638040ab" containerName="extract" Jun 08 18:17:51.831692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831691 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd1f5632-a42c-4973-8800-2b4b0a9b7f80" containerName="util" Jun 08 18:17:51.831692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831699 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd1f5632-a42c-4973-8800-2b4b0a9b7f80" containerName="util" Jun 08 18:17:51.832554 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831707 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d395ca2-dbad-45f0-b7b9-6824e71bdea4" containerName="pull" Jun 08 18:17:51.832554 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831714 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d395ca2-dbad-45f0-b7b9-6824e71bdea4" containerName="pull" Jun 08 18:17:51.832554 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831723 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd1f5632-a42c-4973-8800-2b4b0a9b7f80" containerName="extract" Jun 08 18:17:51.832554 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831730 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd1f5632-a42c-4973-8800-2b4b0a9b7f80" containerName="extract" Jun 08 18:17:51.832554 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831740 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd1f5632-a42c-4973-8800-2b4b0a9b7f80" containerName="pull" Jun 08 18:17:51.832554 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831747 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd1f5632-a42c-4973-8800-2b4b0a9b7f80" containerName="pull" Jun 08 18:17:51.832554 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831755 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0add1f90-e8d3-4d81-8731-d49f638040ab" containerName="pull" Jun 08 18:17:51.832554 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831763 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0add1f90-e8d3-4d81-8731-d49f638040ab" containerName="pull" Jun 08 18:17:51.832554 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831880 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d395ca2-dbad-45f0-b7b9-6824e71bdea4" containerName="extract" Jun 08 18:17:51.832554 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831895 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd1f5632-a42c-4973-8800-2b4b0a9b7f80" containerName="extract" Jun 08 18:17:51.832554 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831908 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0add1f90-e8d3-4d81-8731-d49f638040ab" containerName="extract" Jun 08 18:17:51.832554 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.831917 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e51df07-bd72-4297-ad99-890f2c0bbaf9" containerName="extract" Jun 08 18:17:51.835073 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.835053 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" Jun 08 18:17:51.837561 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.837541 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2bm2v\"" Jun 08 18:17:51.844715 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.844694 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq"] Jun 08 18:17:51.942568 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:51.942517 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k8z5\" (UniqueName: \"kubernetes.io/projected/13bd2acc-4966-4498-b24f-bc82dd17ad0d-kube-api-access-4k8z5\") pod \"limitador-operator-controller-manager-859d7b78bd-fqlwq\" (UID: \"13bd2acc-4966-4498-b24f-bc82dd17ad0d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" Jun 08 18:17:52.043080 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:52.043025 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k8z5\" (UniqueName: \"kubernetes.io/projected/13bd2acc-4966-4498-b24f-bc82dd17ad0d-kube-api-access-4k8z5\") pod \"limitador-operator-controller-manager-859d7b78bd-fqlwq\" (UID: \"13bd2acc-4966-4498-b24f-bc82dd17ad0d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" Jun 08 18:17:52.054868 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:52.054838 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k8z5\" (UniqueName: \"kubernetes.io/projected/13bd2acc-4966-4498-b24f-bc82dd17ad0d-kube-api-access-4k8z5\") pod \"limitador-operator-controller-manager-859d7b78bd-fqlwq\" (UID: \"13bd2acc-4966-4498-b24f-bc82dd17ad0d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" Jun 08 18:17:52.145690 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:52.145592 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" Jun 08 18:17:52.285303 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:52.285267 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq"] Jun 08 18:17:52.288444 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:17:52.288415 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13bd2acc_4966_4498_b24f_bc82dd17ad0d.slice/crio-c26565f483454723aac797e3b2f23aadb6e4b0f474af88b72f991d1af687c7ee WatchSource:0}: Error finding container c26565f483454723aac797e3b2f23aadb6e4b0f474af88b72f991d1af687c7ee: Status 404 returned error can't find the container with id c26565f483454723aac797e3b2f23aadb6e4b0f474af88b72f991d1af687c7ee Jun 08 18:17:52.835530 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:52.835493 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" event={"ID":"13bd2acc-4966-4498-b24f-bc82dd17ad0d","Type":"ContainerStarted","Data":"c26565f483454723aac797e3b2f23aadb6e4b0f474af88b72f991d1af687c7ee"} Jun 08 18:17:53.449593 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:53.449555 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:17:54.848779 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:54.848744 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" event={"ID":"13bd2acc-4966-4498-b24f-bc82dd17ad0d","Type":"ContainerStarted","Data":"b2d13e7174bc54413f71fd919685cd13e3252da65fc744c792199a6ec3891d49"} Jun 08 18:17:54.849183 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:54.848898 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" Jun 08 18:17:54.872767 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:54.872715 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" podStartSLOduration=1.999543759 podStartE2EDuration="3.872700387s" totalImagesPullingTime="1.873156628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:17:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:17:54.87074333 +0000 UTC m=+631.967242800" watchObservedRunningTime="2026-06-08 18:17:54.872700387 +0000 UTC m=+631.969199858" Jun 08 18:17:56.027018 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:56.026977 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:17:57.658990 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:57.658949 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:17:59.179042 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:59.178999 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:17:59.363018 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:59.362980 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:17:59.483325 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:17:59.483290 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:00.583576 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:00.583542 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:01.077873 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:01.077835 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:01.202502 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:01.202464 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:03.464800 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:03.464766 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:04.250430 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:04.250393 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dvmgr"] Jun 08 18:18:04.258489 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:04.258463 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dvmgr" Jun 08 18:18:04.266689 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:04.266664 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qzltf\"" Jun 08 18:18:04.270187 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:04.270160 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dvmgr"] Jun 08 18:18:04.354839 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:04.354798 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgf5f\" (UniqueName: \"kubernetes.io/projected/b8c4562f-f60e-4d6a-8b69-7288fa7a32f1-kube-api-access-jgf5f\") pod \"authorino-operator-75cc8d5cb7-dvmgr\" (UID: \"b8c4562f-f60e-4d6a-8b69-7288fa7a32f1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dvmgr" Jun 08 18:18:04.456093 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:04.456052 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgf5f\" (UniqueName: \"kubernetes.io/projected/b8c4562f-f60e-4d6a-8b69-7288fa7a32f1-kube-api-access-jgf5f\") pod \"authorino-operator-75cc8d5cb7-dvmgr\" (UID: \"b8c4562f-f60e-4d6a-8b69-7288fa7a32f1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dvmgr" Jun 08 18:18:04.466227 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:04.466192 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgf5f\" (UniqueName: \"kubernetes.io/projected/b8c4562f-f60e-4d6a-8b69-7288fa7a32f1-kube-api-access-jgf5f\") pod \"authorino-operator-75cc8d5cb7-dvmgr\" (UID: \"b8c4562f-f60e-4d6a-8b69-7288fa7a32f1\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dvmgr" Jun 08 18:18:04.569405 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:04.569276 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dvmgr" Jun 08 18:18:04.710034 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:04.710008 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dvmgr"] Jun 08 18:18:04.712685 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:18:04.712657 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c4562f_f60e_4d6a_8b69_7288fa7a32f1.slice/crio-7f7d774296ca3e417f865413584e9f25037d7508d0319d01d0905d8884e97414 WatchSource:0}: Error finding container 7f7d774296ca3e417f865413584e9f25037d7508d0319d01d0905d8884e97414: Status 404 returned error can't find the container with id 7f7d774296ca3e417f865413584e9f25037d7508d0319d01d0905d8884e97414 Jun 08 18:18:04.911502 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:04.911411 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dvmgr" event={"ID":"b8c4562f-f60e-4d6a-8b69-7288fa7a32f1","Type":"ContainerStarted","Data":"7f7d774296ca3e417f865413584e9f25037d7508d0319d01d0905d8884e97414"} Jun 08 18:18:05.598268 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:05.598226 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:05.701227 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:05.701181 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:05.857941 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:05.857842 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" Jun 08 18:18:07.586978 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:07.586936 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:07.643596 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:07.643561 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:07.932125 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:07.932032 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dvmgr" event={"ID":"b8c4562f-f60e-4d6a-8b69-7288fa7a32f1","Type":"ContainerStarted","Data":"04c85a2a7899b0bc909a8b49c41edb5d36e2e5297068aac6e23d63e5d1e73682"} Jun 08 18:18:07.932125 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:07.932109 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dvmgr" Jun 08 18:18:07.948975 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:07.948919 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dvmgr" podStartSLOduration=1.599184512 podStartE2EDuration="3.948903971s" totalImagesPullingTime="2.349719459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:18:07.948553373 +0000 UTC m=+645.045052844" watchObservedRunningTime="2026-06-08 18:18:07.948903971 +0000 UTC m=+645.045403441" Jun 08 18:18:11.825430 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:11.825366 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:12.111748 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:12.111657 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:12.808753 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:12.808715 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:12.945419 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:12.945370 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:16.203692 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:16.203647 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:18.939244 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:18.939209 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dvmgr" Jun 08 18:18:21.131113 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:21.131069 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:21.238679 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:21.238640 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:21.340328 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:21.340297 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:21.810056 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:21.810019 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq"] Jun 08 18:18:21.810495 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:21.810282 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" podUID="13bd2acc-4966-4498-b24f-bc82dd17ad0d" containerName="manager" containerID="cri-o://b2d13e7174bc54413f71fd919685cd13e3252da65fc744c792199a6ec3891d49" gracePeriod=2 Jun 08 18:18:21.826682 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:21.826646 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq"] Jun 08 18:18:21.837016 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:18:21.836969 2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"13bd2acc-4966-4498-b24f-bc82dd17ad0d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-fqlwq\": pods \"limitador-operator-controller-manager-859d7b78bd-fqlwq\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" Jun 08 18:18:21.886628 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:21.886597 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxsh"] Jun 08 18:18:21.886955 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:21.886937 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13bd2acc-4966-4498-b24f-bc82dd17ad0d" containerName="manager" Jun 08 18:18:21.886955 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:21.886951 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="13bd2acc-4966-4498-b24f-bc82dd17ad0d" containerName="manager" Jun 08 18:18:21.887114 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:21.887005 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="13bd2acc-4966-4498-b24f-bc82dd17ad0d" containerName="manager" Jun 08 18:18:21.890058 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:21.890042 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxsh" Jun 08 18:18:21.907038 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:21.907008 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxsh"] Jun 08 18:18:21.908109 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:21.908084 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzw8v\" (UniqueName: \"kubernetes.io/projected/20e192f0-bc54-4617-94bd-177643218404-kube-api-access-gzw8v\") pod \"limitador-operator-controller-manager-859d7b78bd-vwxsh\" (UID: \"20e192f0-bc54-4617-94bd-177643218404\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxsh" Jun 08 18:18:21.926549 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:18:21.926515 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqlwq\" is forbidden: User \"system:node:ip-10-0-140-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-216.ec2.internal' and this object" podUID="13bd2acc-4966-4498-b24f-bc82dd17ad0d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" Jun 08 18:18:22.008700 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:22.008659 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzw8v\" (UniqueName: \"kubernetes.io/projected/20e192f0-bc54-4617-94bd-177643218404-kube-api-access-gzw8v\") pod \"limitador-operator-controller-manager-859d7b78bd-vwxsh\" (UID: \"20e192f0-bc54-4617-94bd-177643218404\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxsh" Jun 08 18:18:22.009713 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:22.009684 2556 generic.go:356] "Generic (PLEG): container finished" podID="13bd2acc-4966-4498-b24f-bc82dd17ad0d" containerID="b2d13e7174bc54413f71fd919685cd13e3252da65fc744c792199a6ec3891d49" exitCode=0 Jun 08 18:18:22.018425 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:22.018366 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzw8v\" (UniqueName: \"kubernetes.io/projected/20e192f0-bc54-4617-94bd-177643218404-kube-api-access-gzw8v\") pod \"limitador-operator-controller-manager-859d7b78bd-vwxsh\" (UID: \"20e192f0-bc54-4617-94bd-177643218404\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxsh" Jun 08 18:18:22.055506 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:22.055481 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" Jun 08 18:18:22.057685 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:18:22.057662 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqlwq\" is forbidden: User \"system:node:ip-10-0-140-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-216.ec2.internal' and this object" podUID="13bd2acc-4966-4498-b24f-bc82dd17ad0d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" Jun 08 18:18:22.109745 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:22.109652 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k8z5\" (UniqueName: \"kubernetes.io/projected/13bd2acc-4966-4498-b24f-bc82dd17ad0d-kube-api-access-4k8z5\") pod \"13bd2acc-4966-4498-b24f-bc82dd17ad0d\" (UID: \"13bd2acc-4966-4498-b24f-bc82dd17ad0d\") " Jun 08 18:18:22.111747 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:22.111714 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13bd2acc-4966-4498-b24f-bc82dd17ad0d-kube-api-access-4k8z5" (OuterVolumeSpecName: "kube-api-access-4k8z5") pod "13bd2acc-4966-4498-b24f-bc82dd17ad0d" (UID: "13bd2acc-4966-4498-b24f-bc82dd17ad0d"). InnerVolumeSpecName "kube-api-access-4k8z5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:18:22.202548 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:22.202505 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxsh" Jun 08 18:18:22.210697 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:22.210660 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4k8z5\" (UniqueName: \"kubernetes.io/projected/13bd2acc-4966-4498-b24f-bc82dd17ad0d-kube-api-access-4k8z5\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:18:22.342514 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:22.342459 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxsh"] Jun 08 18:18:22.347240 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:18:22.347193 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e192f0_bc54_4617_94bd_177643218404.slice/crio-68258b9dc81e2d496b26fdcccd4dbf6ec20eff5fbfbfb5909c46219e9eaa33af WatchSource:0}: Error finding container 68258b9dc81e2d496b26fdcccd4dbf6ec20eff5fbfbfb5909c46219e9eaa33af: Status 404 returned error can't find the container with id 68258b9dc81e2d496b26fdcccd4dbf6ec20eff5fbfbfb5909c46219e9eaa33af Jun 08 18:18:23.016920 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:23.016880 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxsh" event={"ID":"20e192f0-bc54-4617-94bd-177643218404","Type":"ContainerStarted","Data":"7ab60c8c1d612d87178aadfb56b0071eb1a90b6f5d4fbd65d88246fde7241706"} Jun 08 18:18:23.017227 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:23.016943 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxsh" Jun 08 18:18:23.017227 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:23.016966 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxsh" event={"ID":"20e192f0-bc54-4617-94bd-177643218404","Type":"ContainerStarted","Data":"68258b9dc81e2d496b26fdcccd4dbf6ec20eff5fbfbfb5909c46219e9eaa33af"} Jun 08 18:18:23.018268 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:23.018247 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" Jun 08 18:18:23.018400 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:23.018254 2556 scope.go:117] "RemoveContainer" containerID="b2d13e7174bc54413f71fd919685cd13e3252da65fc744c792199a6ec3891d49" Jun 08 18:18:23.037139 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:23.037084 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxsh" podStartSLOduration=2.03706845 podStartE2EDuration="2.03706845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:18:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:18:23.036492176 +0000 UTC m=+660.132991645" watchObservedRunningTime="2026-06-08 18:18:23.03706845 +0000 UTC m=+660.133567920" Jun 08 18:18:23.038438 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:18:23.038411 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqlwq\" is forbidden: User \"system:node:ip-10-0-140-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-216.ec2.internal' and this object" podUID="13bd2acc-4966-4498-b24f-bc82dd17ad0d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" Jun 08 18:18:23.043011 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:18:23.042988 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqlwq\" is forbidden: User \"system:node:ip-10-0-140-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-216.ec2.internal' and this object" podUID="13bd2acc-4966-4498-b24f-bc82dd17ad0d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" Jun 08 18:18:23.399325 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:18:23.399283 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-fqlwq\" is forbidden: User \"system:node:ip-10-0-140-216.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-216.ec2.internal' and this object" podUID="13bd2acc-4966-4498-b24f-bc82dd17ad0d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqlwq" Jun 08 18:18:23.400204 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:23.400183 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13bd2acc-4966-4498-b24f-bc82dd17ad0d" path="/var/lib/kubelet/pods/13bd2acc-4966-4498-b24f-bc82dd17ad0d/volumes" Jun 08 18:18:23.648930 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:23.648817 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:23.753704 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:23.753667 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:26.649071 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:26.649030 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:26.757177 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:26.757137 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:30.641366 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:30.641320 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:30.743561 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:30.743507 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:34.026625 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:34.026592 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vwxsh" Jun 08 18:18:36.264722 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:36.264681 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:36.366062 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:36.366025 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:39.145344 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:39.145306 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:39.269490 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:39.269457 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:39.381706 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:39.381665 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:42.018198 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:42.018164 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:18:42.093433 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:18:42.093370 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:19:08.077602 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.077565 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww"] Jun 08 18:19:08.081139 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.081114 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.084704 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.084683 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fnb6q\"" Jun 08 18:19:08.105320 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.105293 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww"] Jun 08 18:19:08.130751 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.130714 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:19:08.205705 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.205670 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/002f6d8f-7434-4958-ace4-95c6a095bf18-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.205884 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.205709 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/002f6d8f-7434-4958-ace4-95c6a095bf18-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.205884 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.205732 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/002f6d8f-7434-4958-ace4-95c6a095bf18-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.205884 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.205800 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/002f6d8f-7434-4958-ace4-95c6a095bf18-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.205884 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.205825 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/002f6d8f-7434-4958-ace4-95c6a095bf18-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.205884 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.205871 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/002f6d8f-7434-4958-ace4-95c6a095bf18-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.206054 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.205887 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/002f6d8f-7434-4958-ace4-95c6a095bf18-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.206054 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.205906 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk7ss\" (UniqueName: \"kubernetes.io/projected/002f6d8f-7434-4958-ace4-95c6a095bf18-kube-api-access-mk7ss\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.206054 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.205923 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/002f6d8f-7434-4958-ace4-95c6a095bf18-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.230147 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.230114 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:19:08.307133 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.307088 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/002f6d8f-7434-4958-ace4-95c6a095bf18-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.307133 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.307137 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/002f6d8f-7434-4958-ace4-95c6a095bf18-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.307431 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.307259 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/002f6d8f-7434-4958-ace4-95c6a095bf18-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.307502 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.307424 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/002f6d8f-7434-4958-ace4-95c6a095bf18-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.307502 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.307463 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/002f6d8f-7434-4958-ace4-95c6a095bf18-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.307622 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.307502 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/002f6d8f-7434-4958-ace4-95c6a095bf18-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.307622 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.307526 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/002f6d8f-7434-4958-ace4-95c6a095bf18-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.307622 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.307557 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk7ss\" (UniqueName: \"kubernetes.io/projected/002f6d8f-7434-4958-ace4-95c6a095bf18-kube-api-access-mk7ss\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.307622 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.307585 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/002f6d8f-7434-4958-ace4-95c6a095bf18-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.307794 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.307634 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/002f6d8f-7434-4958-ace4-95c6a095bf18-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.307872 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.307848 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/002f6d8f-7434-4958-ace4-95c6a095bf18-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.307969 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.307945 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/002f6d8f-7434-4958-ace4-95c6a095bf18-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.308060 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.308041 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/002f6d8f-7434-4958-ace4-95c6a095bf18-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.308125 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.308043 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/002f6d8f-7434-4958-ace4-95c6a095bf18-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.309775 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.309752 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/002f6d8f-7434-4958-ace4-95c6a095bf18-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.309960 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.309942 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/002f6d8f-7434-4958-ace4-95c6a095bf18-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.315302 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.315277 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/002f6d8f-7434-4958-ace4-95c6a095bf18-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.315441 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.315352 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk7ss\" (UniqueName: \"kubernetes.io/projected/002f6d8f-7434-4958-ace4-95c6a095bf18-kube-api-access-mk7ss\") pod \"maas-default-gateway-openshift-default-687ff6996-jxhww\" (UID: \"002f6d8f-7434-4958-ace4-95c6a095bf18\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.392743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.392652 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:08.531530 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.531435 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww"] Jun 08 18:19:08.534272 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:19:08.534230 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002f6d8f_7434_4958_ace4_95c6a095bf18.slice/crio-d625cb004eed8fcb87d7b5402942c179afc999d9e9b7bad16f777571efafa5ae WatchSource:0}: Error finding container d625cb004eed8fcb87d7b5402942c179afc999d9e9b7bad16f777571efafa5ae: Status 404 returned error can't find the container with id d625cb004eed8fcb87d7b5402942c179afc999d9e9b7bad16f777571efafa5ae Jun 08 18:19:08.536511 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.536477 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 18:19:08.536646 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.536551 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 18:19:08.536646 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:08.536581 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 18:19:09.260319 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:09.260279 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" event={"ID":"002f6d8f-7434-4958-ace4-95c6a095bf18","Type":"ContainerStarted","Data":"f3d2fb8671300d387407cd2934e6a5f26f291c30905dc68d568254849408c055"} Jun 08 18:19:09.260749 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:09.260344 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" event={"ID":"002f6d8f-7434-4958-ace4-95c6a095bf18","Type":"ContainerStarted","Data":"d625cb004eed8fcb87d7b5402942c179afc999d9e9b7bad16f777571efafa5ae"} Jun 08 18:19:09.287529 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:09.287474 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" podStartSLOduration=1.287458815 podStartE2EDuration="1.287458815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:19:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:19:09.284921263 +0000 UTC m=+706.381420732" watchObservedRunningTime="2026-06-08 18:19:09.287458815 +0000 UTC m=+706.383958285" Jun 08 18:19:09.393342 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:09.393306 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:09.405515 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:09.405484 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:10.265886 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:10.265857 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:10.267091 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:10.267067 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:19:11.458544 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:11.458505 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:19:12.161304 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:12.161272 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:19:13.378040 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:13.377938 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:19:13.498403 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:13.498338 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:19:13.600496 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:13.600462 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:19:14.335563 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:14.335525 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:19:14.414927 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:14.414895 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:19:33.871400 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:33.871345 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:19:44.466585 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:44.466542 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:19:44.602075 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:44.602035 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:19:44.965278 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:44.965243 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:19:47.473543 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:47.473509 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9"] Jun 08 18:19:47.477095 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:47.477076 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" Jun 08 18:19:47.482623 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:47.482596 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 08 18:19:47.482778 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:47.482646 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-nj8pv\"" Jun 08 18:19:47.483014 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:47.482997 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 08 18:19:47.536971 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:47.536936 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9"] Jun 08 18:19:47.558333 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:47.558291 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2kdv\" (UniqueName: \"kubernetes.io/projected/914d0b18-d661-443c-b099-4728dddfe67a-kube-api-access-v2kdv\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9\" (UID: \"914d0b18-d661-443c-b099-4728dddfe67a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" Jun 08 18:19:47.558333 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:47.558331 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/914d0b18-d661-443c-b099-4728dddfe67a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9\" (UID: \"914d0b18-d661-443c-b099-4728dddfe67a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" Jun 08 18:19:47.558561 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:47.558474 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/914d0b18-d661-443c-b099-4728dddfe67a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9\" (UID: \"914d0b18-d661-443c-b099-4728dddfe67a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" Jun 08 18:19:47.659141 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:47.659094 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/914d0b18-d661-443c-b099-4728dddfe67a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9\" (UID: \"914d0b18-d661-443c-b099-4728dddfe67a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" Jun 08 18:19:47.659141 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:47.659149 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2kdv\" (UniqueName: \"kubernetes.io/projected/914d0b18-d661-443c-b099-4728dddfe67a-kube-api-access-v2kdv\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9\" (UID: \"914d0b18-d661-443c-b099-4728dddfe67a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" Jun 08 18:19:47.659449 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:47.659176 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/914d0b18-d661-443c-b099-4728dddfe67a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9\" (UID: \"914d0b18-d661-443c-b099-4728dddfe67a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" Jun 08 18:19:47.659612 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:47.659589 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/914d0b18-d661-443c-b099-4728dddfe67a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9\" (UID: \"914d0b18-d661-443c-b099-4728dddfe67a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" Jun 08 18:19:47.659677 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:47.659628 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/914d0b18-d661-443c-b099-4728dddfe67a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9\" (UID: \"914d0b18-d661-443c-b099-4728dddfe67a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" Jun 08 18:19:47.675872 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:47.675841 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2kdv\" (UniqueName: \"kubernetes.io/projected/914d0b18-d661-443c-b099-4728dddfe67a-kube-api-access-v2kdv\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9\" (UID: \"914d0b18-d661-443c-b099-4728dddfe67a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" Jun 08 18:19:47.785878 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:47.785785 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" Jun 08 18:19:47.963780 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:47.963754 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9"] Jun 08 18:19:47.966232 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:19:47.966209 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod914d0b18_d661_443c_b099_4728dddfe67a.slice/crio-978c06e2f82d0ea4f0f8f475a684c3231b1f4b5e60262f99656012ee6d9456ee WatchSource:0}: Error finding container 978c06e2f82d0ea4f0f8f475a684c3231b1f4b5e60262f99656012ee6d9456ee: Status 404 returned error can't find the container with id 978c06e2f82d0ea4f0f8f475a684c3231b1f4b5e60262f99656012ee6d9456ee Jun 08 18:19:48.475324 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:48.475291 2556 generic.go:356] "Generic (PLEG): container finished" podID="914d0b18-d661-443c-b099-4728dddfe67a" containerID="16260be8f582496c9854de2057a4b958a06672f30c563fb86fd88ab06c7527f6" exitCode=0 Jun 08 18:19:48.475775 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:48.475392 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" event={"ID":"914d0b18-d661-443c-b099-4728dddfe67a","Type":"ContainerDied","Data":"16260be8f582496c9854de2057a4b958a06672f30c563fb86fd88ab06c7527f6"} Jun 08 18:19:48.475775 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:48.475447 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" event={"ID":"914d0b18-d661-443c-b099-4728dddfe67a","Type":"ContainerStarted","Data":"978c06e2f82d0ea4f0f8f475a684c3231b1f4b5e60262f99656012ee6d9456ee"} Jun 08 18:19:49.482642 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:49.482607 2556 generic.go:356] "Generic (PLEG): container finished" podID="914d0b18-d661-443c-b099-4728dddfe67a" containerID="ce491626f10b335ebb37dd03adb0caaa1a7ccac5078e49f37e60bb91d20dc86b" exitCode=0 Jun 08 18:19:49.483049 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:49.482658 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" event={"ID":"914d0b18-d661-443c-b099-4728dddfe67a","Type":"ContainerDied","Data":"ce491626f10b335ebb37dd03adb0caaa1a7ccac5078e49f37e60bb91d20dc86b"} Jun 08 18:19:50.012131 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:50.012089 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:19:50.490682 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:50.490648 2556 generic.go:356] "Generic (PLEG): container finished" podID="914d0b18-d661-443c-b099-4728dddfe67a" containerID="c085fd37a850e92e63f7b6eb9b36e4a7236994cbc3574c0fea1bc4b2fb197253" exitCode=0 Jun 08 18:19:50.491082 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:50.490701 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" event={"ID":"914d0b18-d661-443c-b099-4728dddfe67a","Type":"ContainerDied","Data":"c085fd37a850e92e63f7b6eb9b36e4a7236994cbc3574c0fea1bc4b2fb197253"} Jun 08 18:19:51.625585 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:51.625554 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" Jun 08 18:19:51.694558 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:51.694528 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/914d0b18-d661-443c-b099-4728dddfe67a-bundle\") pod \"914d0b18-d661-443c-b099-4728dddfe67a\" (UID: \"914d0b18-d661-443c-b099-4728dddfe67a\") " Jun 08 18:19:51.694732 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:51.694583 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2kdv\" (UniqueName: \"kubernetes.io/projected/914d0b18-d661-443c-b099-4728dddfe67a-kube-api-access-v2kdv\") pod \"914d0b18-d661-443c-b099-4728dddfe67a\" (UID: \"914d0b18-d661-443c-b099-4728dddfe67a\") " Jun 08 18:19:51.694732 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:51.694679 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/914d0b18-d661-443c-b099-4728dddfe67a-util\") pod \"914d0b18-d661-443c-b099-4728dddfe67a\" (UID: \"914d0b18-d661-443c-b099-4728dddfe67a\") " Jun 08 18:19:51.695066 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:51.695046 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/914d0b18-d661-443c-b099-4728dddfe67a-bundle" (OuterVolumeSpecName: "bundle") pod "914d0b18-d661-443c-b099-4728dddfe67a" (UID: "914d0b18-d661-443c-b099-4728dddfe67a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:19:51.696754 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:51.696732 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/914d0b18-d661-443c-b099-4728dddfe67a-kube-api-access-v2kdv" (OuterVolumeSpecName: "kube-api-access-v2kdv") pod "914d0b18-d661-443c-b099-4728dddfe67a" (UID: "914d0b18-d661-443c-b099-4728dddfe67a"). InnerVolumeSpecName "kube-api-access-v2kdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:19:51.700746 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:51.700720 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/914d0b18-d661-443c-b099-4728dddfe67a-util" (OuterVolumeSpecName: "util") pod "914d0b18-d661-443c-b099-4728dddfe67a" (UID: "914d0b18-d661-443c-b099-4728dddfe67a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 18:19:51.796147 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:51.796054 2556 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/914d0b18-d661-443c-b099-4728dddfe67a-util\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:19:51.796147 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:51.796087 2556 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/914d0b18-d661-443c-b099-4728dddfe67a-bundle\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:19:51.796147 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:51.796098 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2kdv\" (UniqueName: \"kubernetes.io/projected/914d0b18-d661-443c-b099-4728dddfe67a-kube-api-access-v2kdv\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:19:52.503970 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:52.503939 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" Jun 08 18:19:52.503970 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:52.503962 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748hhwg9" event={"ID":"914d0b18-d661-443c-b099-4728dddfe67a","Type":"ContainerDied","Data":"978c06e2f82d0ea4f0f8f475a684c3231b1f4b5e60262f99656012ee6d9456ee"} Jun 08 18:19:52.504188 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:19:52.504007 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="978c06e2f82d0ea4f0f8f475a684c3231b1f4b5e60262f99656012ee6d9456ee" Jun 08 18:20:06.350449 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:06.350402 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:20:12.088762 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.088719 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:20:12.212603 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.212564 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:20:12.592199 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.592165 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:20:12.592559 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.592543 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="914d0b18-d661-443c-b099-4728dddfe67a" containerName="util" Jun 08 18:20:12.592559 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.592559 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="914d0b18-d661-443c-b099-4728dddfe67a" containerName="util" Jun 08 18:20:12.592689 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.592569 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="914d0b18-d661-443c-b099-4728dddfe67a" containerName="extract" Jun 08 18:20:12.592689 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.592575 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="914d0b18-d661-443c-b099-4728dddfe67a" containerName="extract" Jun 08 18:20:12.592689 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.592583 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="914d0b18-d661-443c-b099-4728dddfe67a" containerName="pull" Jun 08 18:20:12.592689 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.592589 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="914d0b18-d661-443c-b099-4728dddfe67a" containerName="pull" Jun 08 18:20:12.592689 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.592658 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="914d0b18-d661-443c-b099-4728dddfe67a" containerName="extract" Jun 08 18:20:12.595910 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.595892 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 18:20:12.598993 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.598969 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-7nmc2\"" Jun 08 18:20:12.599094 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.599010 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 18:20:12.599800 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.599776 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 18:20:12.599916 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.599827 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 18:20:12.617038 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.617004 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:20:12.691129 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.691082 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpgng\" (UniqueName: \"kubernetes.io/projected/fca47101-87f5-4542-a7f0-fa5f2504ffb3-kube-api-access-wpgng\") pod \"maas-keycloak-0\" (UID: \"fca47101-87f5-4542-a7f0-fa5f2504ffb3\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:20:12.792592 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.792546 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpgng\" (UniqueName: \"kubernetes.io/projected/fca47101-87f5-4542-a7f0-fa5f2504ffb3-kube-api-access-wpgng\") pod \"maas-keycloak-0\" (UID: \"fca47101-87f5-4542-a7f0-fa5f2504ffb3\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:20:12.802224 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.802195 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpgng\" (UniqueName: \"kubernetes.io/projected/fca47101-87f5-4542-a7f0-fa5f2504ffb3-kube-api-access-wpgng\") pod \"maas-keycloak-0\" (UID: \"fca47101-87f5-4542-a7f0-fa5f2504ffb3\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:20:12.905573 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:12.905472 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 18:20:13.054730 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:13.054699 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:20:13.056149 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:20:13.056120 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfca47101_87f5_4542_a7f0_fa5f2504ffb3.slice/crio-c024c324402a603a8efff2ffd5f4e33e6a3bec61880222c10130c9b10b52a5c5 WatchSource:0}: Error finding container c024c324402a603a8efff2ffd5f4e33e6a3bec61880222c10130c9b10b52a5c5: Status 404 returned error can't find the container with id c024c324402a603a8efff2ffd5f4e33e6a3bec61880222c10130c9b10b52a5c5 Jun 08 18:20:13.628131 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:13.628089 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"fca47101-87f5-4542-a7f0-fa5f2504ffb3","Type":"ContainerStarted","Data":"c024c324402a603a8efff2ffd5f4e33e6a3bec61880222c10130c9b10b52a5c5"} Jun 08 18:20:18.665887 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:18.665792 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"fca47101-87f5-4542-a7f0-fa5f2504ffb3","Type":"ContainerStarted","Data":"894663f3bc9c9e9702798c36c23100dffa13a681290c7c13feb19316b8affda9"} Jun 08 18:20:18.906448 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:18.906404 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 18:20:18.908091 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:18.908056 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 08 18:20:19.906791 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:19.906732 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 08 18:20:20.906417 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:20.906348 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 08 18:20:21.906399 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:21.906339 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 08 18:20:22.906496 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:22.906449 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 18:20:22.906926 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:22.906798 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 08 18:20:23.906037 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:23.905975 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 08 18:20:24.906197 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:24.906140 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 08 18:20:25.906694 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:25.906641 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 08 18:20:26.906179 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:26.906126 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 08 18:20:27.906809 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:27.906760 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 08 18:20:28.906863 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:28.906801 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 08 18:20:29.906964 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:29.906910 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 08 18:20:30.906399 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:30.906330 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.45:9000/health/started\": dial tcp 10.132.0.45:9000: connect: connection refused" Jun 08 18:20:32.021887 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:32.021844 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 18:20:32.036793 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:32.036743 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 18:20:32.061298 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:32.061236 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=14.837193496 podStartE2EDuration="20.061218272s" totalImagesPullingTime="5.224024776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:20:18.699411341 +0000 UTC m=+775.795910811" watchObservedRunningTime="2026-06-08 18:20:32.061218272 +0000 UTC m=+789.157717741" Jun 08 18:20:42.028587 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:42.028546 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 18:20:42.732763 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:42.732724 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:20:42.897572 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:42.897483 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:20:49.120631 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.120594 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:20:49.134848 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.134815 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7b4bd47db4-d7dqw"] Jun 08 18:20:49.138260 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.138238 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" Jun 08 18:20:49.141300 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.141276 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 08 18:20:49.141450 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.141319 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 08 18:20:49.141450 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.141285 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dhkbg\"" Jun 08 18:20:49.147952 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.147928 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b4bd47db4-d7dqw"] Jun 08 18:20:49.227730 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.227695 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:20:49.248714 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.248680 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqr5l\" (UniqueName: \"kubernetes.io/projected/172be40d-b7c9-41f0-89e8-24ac5d6ae302-kube-api-access-mqr5l\") pod \"maas-controller-7b4bd47db4-d7dqw\" (UID: \"172be40d-b7c9-41f0-89e8-24ac5d6ae302\") " pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" Jun 08 18:20:49.248859 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.248719 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/172be40d-b7c9-41f0-89e8-24ac5d6ae302-webhook-cert\") pod \"maas-controller-7b4bd47db4-d7dqw\" (UID: \"172be40d-b7c9-41f0-89e8-24ac5d6ae302\") " pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" Jun 08 18:20:49.314547 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.314512 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:20:49.322742 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.322709 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-56df96974c-4lhps"] Jun 08 18:20:49.326223 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.326208 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56df96974c-4lhps" Jun 08 18:20:49.336523 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.336498 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56df96974c-4lhps"] Jun 08 18:20:49.349579 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.349552 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63cf068c-2d9c-4d3f-99a1-1cb353eddeb1-webhook-cert\") pod \"maas-controller-56df96974c-4lhps\" (UID: \"63cf068c-2d9c-4d3f-99a1-1cb353eddeb1\") " pod="opendatahub/maas-controller-56df96974c-4lhps" Jun 08 18:20:49.349734 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.349589 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m55fc\" (UniqueName: \"kubernetes.io/projected/63cf068c-2d9c-4d3f-99a1-1cb353eddeb1-kube-api-access-m55fc\") pod \"maas-controller-56df96974c-4lhps\" (UID: \"63cf068c-2d9c-4d3f-99a1-1cb353eddeb1\") " pod="opendatahub/maas-controller-56df96974c-4lhps" Jun 08 18:20:49.349734 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.349619 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqr5l\" (UniqueName: \"kubernetes.io/projected/172be40d-b7c9-41f0-89e8-24ac5d6ae302-kube-api-access-mqr5l\") pod \"maas-controller-7b4bd47db4-d7dqw\" (UID: \"172be40d-b7c9-41f0-89e8-24ac5d6ae302\") " pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" Jun 08 18:20:49.349734 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.349675 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/172be40d-b7c9-41f0-89e8-24ac5d6ae302-webhook-cert\") pod \"maas-controller-7b4bd47db4-d7dqw\" (UID: \"172be40d-b7c9-41f0-89e8-24ac5d6ae302\") " pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" Jun 08 18:20:49.352347 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.352319 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/172be40d-b7c9-41f0-89e8-24ac5d6ae302-webhook-cert\") pod \"maas-controller-7b4bd47db4-d7dqw\" (UID: \"172be40d-b7c9-41f0-89e8-24ac5d6ae302\") " pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" Jun 08 18:20:49.360220 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.360188 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqr5l\" (UniqueName: \"kubernetes.io/projected/172be40d-b7c9-41f0-89e8-24ac5d6ae302-kube-api-access-mqr5l\") pod \"maas-controller-7b4bd47db4-d7dqw\" (UID: \"172be40d-b7c9-41f0-89e8-24ac5d6ae302\") " pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" Jun 08 18:20:49.449964 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.449864 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" Jun 08 18:20:49.450229 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.450080 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63cf068c-2d9c-4d3f-99a1-1cb353eddeb1-webhook-cert\") pod \"maas-controller-56df96974c-4lhps\" (UID: \"63cf068c-2d9c-4d3f-99a1-1cb353eddeb1\") " pod="opendatahub/maas-controller-56df96974c-4lhps" Jun 08 18:20:49.450229 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.450112 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m55fc\" (UniqueName: \"kubernetes.io/projected/63cf068c-2d9c-4d3f-99a1-1cb353eddeb1-kube-api-access-m55fc\") pod \"maas-controller-56df96974c-4lhps\" (UID: \"63cf068c-2d9c-4d3f-99a1-1cb353eddeb1\") " pod="opendatahub/maas-controller-56df96974c-4lhps" Jun 08 18:20:49.452602 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.452566 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/63cf068c-2d9c-4d3f-99a1-1cb353eddeb1-webhook-cert\") pod \"maas-controller-56df96974c-4lhps\" (UID: \"63cf068c-2d9c-4d3f-99a1-1cb353eddeb1\") " pod="opendatahub/maas-controller-56df96974c-4lhps" Jun 08 18:20:49.459107 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.459079 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m55fc\" (UniqueName: \"kubernetes.io/projected/63cf068c-2d9c-4d3f-99a1-1cb353eddeb1-kube-api-access-m55fc\") pod \"maas-controller-56df96974c-4lhps\" (UID: \"63cf068c-2d9c-4d3f-99a1-1cb353eddeb1\") " pod="opendatahub/maas-controller-56df96974c-4lhps" Jun 08 18:20:49.596964 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.596933 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7b4bd47db4-d7dqw"] Jun 08 18:20:49.598106 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:20:49.598076 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172be40d_b7c9_41f0_89e8_24ac5d6ae302.slice/crio-94625d68694b4e0dbe0dc2447fa02c8f0e3fd27ce508a96efaaa5de2fa7a7c17 WatchSource:0}: Error finding container 94625d68694b4e0dbe0dc2447fa02c8f0e3fd27ce508a96efaaa5de2fa7a7c17: Status 404 returned error can't find the container with id 94625d68694b4e0dbe0dc2447fa02c8f0e3fd27ce508a96efaaa5de2fa7a7c17 Jun 08 18:20:49.637500 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.637457 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-56df96974c-4lhps" Jun 08 18:20:49.781887 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.781858 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-56df96974c-4lhps"] Jun 08 18:20:49.783034 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:20:49.783008 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63cf068c_2d9c_4d3f_99a1_1cb353eddeb1.slice/crio-214782bb0f1e867ee905c0d46b9698a8a629b4f5d1768b015d8858b924051a98 WatchSource:0}: Error finding container 214782bb0f1e867ee905c0d46b9698a8a629b4f5d1768b015d8858b924051a98: Status 404 returned error can't find the container with id 214782bb0f1e867ee905c0d46b9698a8a629b4f5d1768b015d8858b924051a98 Jun 08 18:20:49.885580 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.885544 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56df96974c-4lhps" event={"ID":"63cf068c-2d9c-4d3f-99a1-1cb353eddeb1","Type":"ContainerStarted","Data":"214782bb0f1e867ee905c0d46b9698a8a629b4f5d1768b015d8858b924051a98"} Jun 08 18:20:49.886744 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:49.886718 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" event={"ID":"172be40d-b7c9-41f0-89e8-24ac5d6ae302","Type":"ContainerStarted","Data":"94625d68694b4e0dbe0dc2447fa02c8f0e3fd27ce508a96efaaa5de2fa7a7c17"} Jun 08 18:20:52.660176 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:52.660074 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:20:52.796293 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:52.796260 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:20:52.914310 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:52.914196 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-56df96974c-4lhps" event={"ID":"63cf068c-2d9c-4d3f-99a1-1cb353eddeb1","Type":"ContainerStarted","Data":"beb2f3056fead44225f546cf29cfe7a4c6d096acda80b9768af5f577d9970c02"} Jun 08 18:20:52.914525 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:52.914325 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-56df96974c-4lhps" Jun 08 18:20:52.915978 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:52.915955 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" event={"ID":"172be40d-b7c9-41f0-89e8-24ac5d6ae302","Type":"ContainerStarted","Data":"77b45f716336293a6d104e87f98de6db8acb9a111379ccc6bcb26c270655206f"} Jun 08 18:20:52.916097 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:52.916077 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" Jun 08 18:20:52.943923 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:52.943870 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-56df96974c-4lhps" podStartSLOduration=1.313677052 podStartE2EDuration="3.9438524s" totalImagesPullingTime="2.630175348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:20:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:20:52.941527795 +0000 UTC m=+810.038027267" watchObservedRunningTime="2026-06-08 18:20:52.9438524 +0000 UTC m=+810.040351848" Jun 08 18:20:52.964942 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:20:52.964895 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" podStartSLOduration=1.142705359 podStartE2EDuration="3.964877054s" totalImagesPullingTime="2.822171695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:20:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:20:52.963838544 +0000 UTC m=+810.060338029" watchObservedRunningTime="2026-06-08 18:20:52.964877054 +0000 UTC m=+810.061376523" Jun 08 18:21:03.928430 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:03.928394 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" Jun 08 18:21:03.928826 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:03.928477 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-56df96974c-4lhps" Jun 08 18:21:03.999337 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:03.999286 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b4bd47db4-d7dqw"] Jun 08 18:21:03.999620 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:03.999586 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" podUID="172be40d-b7c9-41f0-89e8-24ac5d6ae302" containerName="manager" containerID="cri-o://77b45f716336293a6d104e87f98de6db8acb9a111379ccc6bcb26c270655206f" gracePeriod=30 Jun 08 18:21:04.255763 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:04.255736 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" Jun 08 18:21:04.390834 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:04.390795 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/172be40d-b7c9-41f0-89e8-24ac5d6ae302-webhook-cert\") pod \"172be40d-b7c9-41f0-89e8-24ac5d6ae302\" (UID: \"172be40d-b7c9-41f0-89e8-24ac5d6ae302\") " Jun 08 18:21:04.391036 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:04.390862 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqr5l\" (UniqueName: \"kubernetes.io/projected/172be40d-b7c9-41f0-89e8-24ac5d6ae302-kube-api-access-mqr5l\") pod \"172be40d-b7c9-41f0-89e8-24ac5d6ae302\" (UID: \"172be40d-b7c9-41f0-89e8-24ac5d6ae302\") " Jun 08 18:21:04.393055 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:04.393026 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/172be40d-b7c9-41f0-89e8-24ac5d6ae302-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "172be40d-b7c9-41f0-89e8-24ac5d6ae302" (UID: "172be40d-b7c9-41f0-89e8-24ac5d6ae302"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 18:21:04.393159 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:04.393085 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/172be40d-b7c9-41f0-89e8-24ac5d6ae302-kube-api-access-mqr5l" (OuterVolumeSpecName: "kube-api-access-mqr5l") pod "172be40d-b7c9-41f0-89e8-24ac5d6ae302" (UID: "172be40d-b7c9-41f0-89e8-24ac5d6ae302"). InnerVolumeSpecName "kube-api-access-mqr5l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:21:04.492167 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:04.492077 2556 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/172be40d-b7c9-41f0-89e8-24ac5d6ae302-webhook-cert\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:21:04.492167 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:04.492109 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqr5l\" (UniqueName: \"kubernetes.io/projected/172be40d-b7c9-41f0-89e8-24ac5d6ae302-kube-api-access-mqr5l\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:21:04.984437 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:04.984404 2556 generic.go:356] "Generic (PLEG): container finished" podID="172be40d-b7c9-41f0-89e8-24ac5d6ae302" containerID="77b45f716336293a6d104e87f98de6db8acb9a111379ccc6bcb26c270655206f" exitCode=0 Jun 08 18:21:04.984884 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:04.984454 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" event={"ID":"172be40d-b7c9-41f0-89e8-24ac5d6ae302","Type":"ContainerDied","Data":"77b45f716336293a6d104e87f98de6db8acb9a111379ccc6bcb26c270655206f"} Jun 08 18:21:04.984884 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:04.984474 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" Jun 08 18:21:04.984884 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:04.984499 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7b4bd47db4-d7dqw" event={"ID":"172be40d-b7c9-41f0-89e8-24ac5d6ae302","Type":"ContainerDied","Data":"94625d68694b4e0dbe0dc2447fa02c8f0e3fd27ce508a96efaaa5de2fa7a7c17"} Jun 08 18:21:04.984884 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:04.984523 2556 scope.go:117] "RemoveContainer" containerID="77b45f716336293a6d104e87f98de6db8acb9a111379ccc6bcb26c270655206f" Jun 08 18:21:05.001993 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:05.001827 2556 scope.go:117] "RemoveContainer" containerID="77b45f716336293a6d104e87f98de6db8acb9a111379ccc6bcb26c270655206f" Jun 08 18:21:05.002205 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:21:05.002186 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77b45f716336293a6d104e87f98de6db8acb9a111379ccc6bcb26c270655206f\": container with ID starting with 77b45f716336293a6d104e87f98de6db8acb9a111379ccc6bcb26c270655206f not found: ID does not exist" containerID="77b45f716336293a6d104e87f98de6db8acb9a111379ccc6bcb26c270655206f" Jun 08 18:21:05.002264 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:05.002211 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77b45f716336293a6d104e87f98de6db8acb9a111379ccc6bcb26c270655206f"} err="failed to get container status \"77b45f716336293a6d104e87f98de6db8acb9a111379ccc6bcb26c270655206f\": rpc error: code = NotFound desc = could not find container \"77b45f716336293a6d104e87f98de6db8acb9a111379ccc6bcb26c270655206f\": container with ID starting with 77b45f716336293a6d104e87f98de6db8acb9a111379ccc6bcb26c270655206f not found: ID does not exist" Jun 08 18:21:05.010653 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:05.010622 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7b4bd47db4-d7dqw"] Jun 08 18:21:05.013083 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:05.013054 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7b4bd47db4-d7dqw"] Jun 08 18:21:05.400695 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:05.400614 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="172be40d-b7c9-41f0-89e8-24ac5d6ae302" path="/var/lib/kubelet/pods/172be40d-b7c9-41f0-89e8-24ac5d6ae302/volumes" Jun 08 18:21:23.712955 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:23.712873 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:21:23.763676 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:23.763639 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-67b9f5697d-b5lss"] Jun 08 18:21:23.764049 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:23.764036 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="172be40d-b7c9-41f0-89e8-24ac5d6ae302" containerName="manager" Jun 08 18:21:23.764103 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:23.764051 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="172be40d-b7c9-41f0-89e8-24ac5d6ae302" containerName="manager" Jun 08 18:21:23.764145 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:23.764130 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="172be40d-b7c9-41f0-89e8-24ac5d6ae302" containerName="manager" Jun 08 18:21:23.770227 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:23.770197 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-67b9f5697d-b5lss" Jun 08 18:21:23.772874 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:23.772848 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bcx7g\"" Jun 08 18:21:23.772874 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:23.772858 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 08 18:21:23.778203 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:23.778168 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-67b9f5697d-b5lss"] Jun 08 18:21:23.870345 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:23.870303 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfc6p\" (UniqueName: \"kubernetes.io/projected/e5a5d5af-fc02-464b-ba8e-5586dd080851-kube-api-access-zfc6p\") pod \"maas-api-67b9f5697d-b5lss\" (UID: \"e5a5d5af-fc02-464b-ba8e-5586dd080851\") " pod="opendatahub/maas-api-67b9f5697d-b5lss" Jun 08 18:21:23.870544 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:23.870360 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a5d5af-fc02-464b-ba8e-5586dd080851-maas-api-tls\") pod \"maas-api-67b9f5697d-b5lss\" (UID: \"e5a5d5af-fc02-464b-ba8e-5586dd080851\") " pod="opendatahub/maas-api-67b9f5697d-b5lss" Jun 08 18:21:23.971619 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:23.971576 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfc6p\" (UniqueName: \"kubernetes.io/projected/e5a5d5af-fc02-464b-ba8e-5586dd080851-kube-api-access-zfc6p\") pod \"maas-api-67b9f5697d-b5lss\" (UID: \"e5a5d5af-fc02-464b-ba8e-5586dd080851\") " pod="opendatahub/maas-api-67b9f5697d-b5lss" Jun 08 18:21:23.971809 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:23.971631 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a5d5af-fc02-464b-ba8e-5586dd080851-maas-api-tls\") pod \"maas-api-67b9f5697d-b5lss\" (UID: \"e5a5d5af-fc02-464b-ba8e-5586dd080851\") " pod="opendatahub/maas-api-67b9f5697d-b5lss" Jun 08 18:21:23.974241 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:23.974211 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a5d5af-fc02-464b-ba8e-5586dd080851-maas-api-tls\") pod \"maas-api-67b9f5697d-b5lss\" (UID: \"e5a5d5af-fc02-464b-ba8e-5586dd080851\") " pod="opendatahub/maas-api-67b9f5697d-b5lss" Jun 08 18:21:23.980889 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:23.980860 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfc6p\" (UniqueName: \"kubernetes.io/projected/e5a5d5af-fc02-464b-ba8e-5586dd080851-kube-api-access-zfc6p\") pod \"maas-api-67b9f5697d-b5lss\" (UID: \"e5a5d5af-fc02-464b-ba8e-5586dd080851\") " pod="opendatahub/maas-api-67b9f5697d-b5lss" Jun 08 18:21:23.993448 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:23.993406 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:21:24.084185 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:24.084153 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-67b9f5697d-b5lss" Jun 08 18:21:24.184545 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:24.184504 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:21:24.225948 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:24.225918 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-67b9f5697d-b5lss"] Jun 08 18:21:24.226937 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:21:24.226914 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a5d5af_fc02_464b_ba8e_5586dd080851.slice/crio-66f5029c54b24ee8af6d94703b9f832ba8912cb9313bd5c298d5c60d30d2863f WatchSource:0}: Error finding container 66f5029c54b24ee8af6d94703b9f832ba8912cb9313bd5c298d5c60d30d2863f: Status 404 returned error can't find the container with id 66f5029c54b24ee8af6d94703b9f832ba8912cb9313bd5c298d5c60d30d2863f Jun 08 18:21:24.286767 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:24.286728 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:21:24.308666 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:24.308631 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-9vf8s"] Jun 08 18:21:24.313358 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:24.313336 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-9vf8s" Jun 08 18:21:24.315901 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:24.315882 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5xlxp\"" Jun 08 18:21:24.316010 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:24.315911 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 08 18:21:24.326496 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:24.326469 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-9vf8s"] Jun 08 18:21:24.477493 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:24.477397 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbbqt\" (UniqueName: \"kubernetes.io/projected/73568bf2-098c-4325-ad00-2b890068697b-kube-api-access-xbbqt\") pod \"payload-pre-processing-67d7689b65-9vf8s\" (UID: \"73568bf2-098c-4325-ad00-2b890068697b\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-9vf8s" Jun 08 18:21:24.578843 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:24.578802 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbbqt\" (UniqueName: \"kubernetes.io/projected/73568bf2-098c-4325-ad00-2b890068697b-kube-api-access-xbbqt\") pod \"payload-pre-processing-67d7689b65-9vf8s\" (UID: \"73568bf2-098c-4325-ad00-2b890068697b\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-9vf8s" Jun 08 18:21:24.588994 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:24.588965 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbbqt\" (UniqueName: \"kubernetes.io/projected/73568bf2-098c-4325-ad00-2b890068697b-kube-api-access-xbbqt\") pod \"payload-pre-processing-67d7689b65-9vf8s\" (UID: \"73568bf2-098c-4325-ad00-2b890068697b\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-9vf8s" Jun 08 18:21:24.624814 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:24.624779 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-9vf8s" Jun 08 18:21:24.764079 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:24.764045 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-9vf8s"] Jun 08 18:21:24.765670 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:21:24.765640 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73568bf2_098c_4325_ad00_2b890068697b.slice/crio-f44691c1b48988429a940656d2f70c112b6fdda8b4f1c5a5a16d892a33a0df7b WatchSource:0}: Error finding container f44691c1b48988429a940656d2f70c112b6fdda8b4f1c5a5a16d892a33a0df7b: Status 404 returned error can't find the container with id f44691c1b48988429a940656d2f70c112b6fdda8b4f1c5a5a16d892a33a0df7b Jun 08 18:21:25.104291 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:25.104193 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-9vf8s" event={"ID":"73568bf2-098c-4325-ad00-2b890068697b","Type":"ContainerStarted","Data":"f44691c1b48988429a940656d2f70c112b6fdda8b4f1c5a5a16d892a33a0df7b"} Jun 08 18:21:25.105647 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:25.105607 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-67b9f5697d-b5lss" event={"ID":"e5a5d5af-fc02-464b-ba8e-5586dd080851","Type":"ContainerStarted","Data":"66f5029c54b24ee8af6d94703b9f832ba8912cb9313bd5c298d5c60d30d2863f"} Jun 08 18:21:27.142482 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:27.142436 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-67b9f5697d-b5lss" event={"ID":"e5a5d5af-fc02-464b-ba8e-5586dd080851","Type":"ContainerStarted","Data":"eade60e15fe0765196fe5d041c4c5aea9fecacfd3f85ab984c74cba0d598d018"} Jun 08 18:21:27.142941 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:27.142629 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-67b9f5697d-b5lss" Jun 08 18:21:27.144060 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:27.144038 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-9vf8s" event={"ID":"73568bf2-098c-4325-ad00-2b890068697b","Type":"ContainerStarted","Data":"6d484007153d16294ba2fabd5d5d1d97f9371b763b482d4abba1199e129154c8"} Jun 08 18:21:27.144152 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:27.144136 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-9vf8s" Jun 08 18:21:27.173883 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:27.173826 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-67b9f5697d-b5lss" podStartSLOduration=2.102094648 podStartE2EDuration="4.173811199s" totalImagesPullingTime="2.071716551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:21:27.172148105 +0000 UTC m=+844.268647577" watchObservedRunningTime="2026-06-08 18:21:27.173811199 +0000 UTC m=+844.270310668" Jun 08 18:21:27.192937 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:27.192884 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-9vf8s" podStartSLOduration=1.599403518 podStartE2EDuration="3.192868671s" totalImagesPullingTime="1.593465153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:21:27.19021157 +0000 UTC m=+844.286711040" watchObservedRunningTime="2026-06-08 18:21:27.192868671 +0000 UTC m=+844.289368140" Jun 08 18:21:32.176412 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:32.176307 2556 generic.go:356] "Generic (PLEG): container finished" podID="002f6d8f-7434-4958-ace4-95c6a095bf18" containerID="f3d2fb8671300d387407cd2934e6a5f26f291c30905dc68d568254849408c055" exitCode=0 Jun 08 18:21:32.176841 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:32.176403 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" event={"ID":"002f6d8f-7434-4958-ace4-95c6a095bf18","Type":"ContainerDied","Data":"f3d2fb8671300d387407cd2934e6a5f26f291c30905dc68d568254849408c055"} Jun 08 18:21:32.176841 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:32.176773 2556 scope.go:117] "RemoveContainer" containerID="f3d2fb8671300d387407cd2934e6a5f26f291c30905dc68d568254849408c055" Jun 08 18:21:32.177804 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:32.177774 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 18:21:32.177882 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:32.177850 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 18:21:32.177925 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:32.177883 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 18:21:33.154759 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:33.154730 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-67b9f5697d-b5lss" Jun 08 18:21:33.185620 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:33.185582 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" event={"ID":"002f6d8f-7434-4958-ace4-95c6a095bf18","Type":"ContainerStarted","Data":"df069ae3ccb8e0b1130d7f6c16215ccf849ab47cfc11527940165e1b1bec5b55"} Jun 08 18:21:33.393975 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:33.393931 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-jxhww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jun 08 18:21:33.394187 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:33.393989 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" podUID="002f6d8f-7434-4958-ace4-95c6a095bf18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jun 08 18:21:33.406840 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:33.406761 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:21:34.393359 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:34.393316 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-jxhww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jun 08 18:21:34.393359 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:34.393374 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" podUID="002f6d8f-7434-4958-ace4-95c6a095bf18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jun 08 18:21:34.969434 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:34.969396 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:21:34.969649 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:34.969625 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" containerID="cri-o://894663f3bc9c9e9702798c36c23100dffa13a681290c7c13feb19316b8affda9" gracePeriod=30 Jun 08 18:21:35.394003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:35.393906 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-jxhww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jun 08 18:21:35.394003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:35.393977 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" podUID="002f6d8f-7434-4958-ace4-95c6a095bf18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jun 08 18:21:36.393632 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:36.393590 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-jxhww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jun 08 18:21:36.393817 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:36.393660 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" podUID="002f6d8f-7434-4958-ace4-95c6a095bf18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jun 08 18:21:36.660305 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:36.660244 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 18:21:36.680299 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:36.680222 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpgng\" (UniqueName: \"kubernetes.io/projected/fca47101-87f5-4542-a7f0-fa5f2504ffb3-kube-api-access-wpgng\") pod \"fca47101-87f5-4542-a7f0-fa5f2504ffb3\" (UID: \"fca47101-87f5-4542-a7f0-fa5f2504ffb3\") " Jun 08 18:21:36.683027 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:36.682984 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fca47101-87f5-4542-a7f0-fa5f2504ffb3-kube-api-access-wpgng" (OuterVolumeSpecName: "kube-api-access-wpgng") pod "fca47101-87f5-4542-a7f0-fa5f2504ffb3" (UID: "fca47101-87f5-4542-a7f0-fa5f2504ffb3"). InnerVolumeSpecName "kube-api-access-wpgng". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 18:21:36.781511 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:36.781472 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpgng\" (UniqueName: \"kubernetes.io/projected/fca47101-87f5-4542-a7f0-fa5f2504ffb3-kube-api-access-wpgng\") on node \"ip-10-0-140-216.ec2.internal\" DevicePath \"\"" Jun 08 18:21:37.210140 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.210106 2556 generic.go:356] "Generic (PLEG): container finished" podID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerID="894663f3bc9c9e9702798c36c23100dffa13a681290c7c13feb19316b8affda9" exitCode=143 Jun 08 18:21:37.210334 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.210150 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 18:21:37.210334 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.210186 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"fca47101-87f5-4542-a7f0-fa5f2504ffb3","Type":"ContainerDied","Data":"894663f3bc9c9e9702798c36c23100dffa13a681290c7c13feb19316b8affda9"} Jun 08 18:21:37.210334 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.210234 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"fca47101-87f5-4542-a7f0-fa5f2504ffb3","Type":"ContainerDied","Data":"c024c324402a603a8efff2ffd5f4e33e6a3bec61880222c10130c9b10b52a5c5"} Jun 08 18:21:37.210334 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.210256 2556 scope.go:117] "RemoveContainer" containerID="894663f3bc9c9e9702798c36c23100dffa13a681290c7c13feb19316b8affda9" Jun 08 18:21:37.220481 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.220463 2556 scope.go:117] "RemoveContainer" containerID="894663f3bc9c9e9702798c36c23100dffa13a681290c7c13feb19316b8affda9" Jun 08 18:21:37.220753 ip-10-0-140-216 kubenswrapper[2556]: E0608 18:21:37.220733 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"894663f3bc9c9e9702798c36c23100dffa13a681290c7c13feb19316b8affda9\": container with ID starting with 894663f3bc9c9e9702798c36c23100dffa13a681290c7c13feb19316b8affda9 not found: ID does not exist" containerID="894663f3bc9c9e9702798c36c23100dffa13a681290c7c13feb19316b8affda9" Jun 08 18:21:37.220824 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.220766 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"894663f3bc9c9e9702798c36c23100dffa13a681290c7c13feb19316b8affda9"} err="failed to get container status \"894663f3bc9c9e9702798c36c23100dffa13a681290c7c13feb19316b8affda9\": rpc error: code = NotFound desc = could not find container \"894663f3bc9c9e9702798c36c23100dffa13a681290c7c13feb19316b8affda9\": container with ID starting with 894663f3bc9c9e9702798c36c23100dffa13a681290c7c13feb19316b8affda9 not found: ID does not exist" Jun 08 18:21:37.232111 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.232086 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:21:37.235619 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.235599 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:21:37.259148 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.259112 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:21:37.259565 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.259549 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" Jun 08 18:21:37.259565 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.259566 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" Jun 08 18:21:37.259678 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.259624 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" containerName="keycloak" Jun 08 18:21:37.264352 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.264336 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 18:21:37.267029 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.267007 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 08 18:21:37.267139 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.267008 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 18:21:37.267139 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.267056 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 18:21:37.267257 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.267164 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-7nmc2\"" Jun 08 18:21:37.267257 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.267167 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 18:21:37.275281 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.275259 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:21:37.285765 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.285739 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/2a8d57ea-6ae9-425d-96bf-8cb9eba30606-test-realms\") pod \"maas-keycloak-0\" (UID: \"2a8d57ea-6ae9-425d-96bf-8cb9eba30606\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:21:37.285914 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.285789 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mn7x\" (UniqueName: \"kubernetes.io/projected/2a8d57ea-6ae9-425d-96bf-8cb9eba30606-kube-api-access-6mn7x\") pod \"maas-keycloak-0\" (UID: \"2a8d57ea-6ae9-425d-96bf-8cb9eba30606\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:21:37.386307 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.386265 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/2a8d57ea-6ae9-425d-96bf-8cb9eba30606-test-realms\") pod \"maas-keycloak-0\" (UID: \"2a8d57ea-6ae9-425d-96bf-8cb9eba30606\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:21:37.386522 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.386319 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mn7x\" (UniqueName: \"kubernetes.io/projected/2a8d57ea-6ae9-425d-96bf-8cb9eba30606-kube-api-access-6mn7x\") pod \"maas-keycloak-0\" (UID: \"2a8d57ea-6ae9-425d-96bf-8cb9eba30606\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:21:37.387045 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.387021 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/2a8d57ea-6ae9-425d-96bf-8cb9eba30606-test-realms\") pod \"maas-keycloak-0\" (UID: \"2a8d57ea-6ae9-425d-96bf-8cb9eba30606\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:21:37.395594 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.395564 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mn7x\" (UniqueName: \"kubernetes.io/projected/2a8d57ea-6ae9-425d-96bf-8cb9eba30606-kube-api-access-6mn7x\") pod \"maas-keycloak-0\" (UID: \"2a8d57ea-6ae9-425d-96bf-8cb9eba30606\") " pod="keycloak-system/maas-keycloak-0" Jun 08 18:21:37.400694 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.400661 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fca47101-87f5-4542-a7f0-fa5f2504ffb3" path="/var/lib/kubelet/pods/fca47101-87f5-4542-a7f0-fa5f2504ffb3/volumes" Jun 08 18:21:37.401003 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.400989 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:21:37.401365 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.401343 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:21:37.402172 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.402156 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-jxhww" Jun 08 18:21:37.581651 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.581613 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 18:21:37.719451 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:37.719425 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 18:21:37.720475 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:21:37.720443 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a8d57ea_6ae9_425d_96bf_8cb9eba30606.slice/crio-113ca7f81fd797f27376c6bf7de65ed5a18d8470904d71a4fb40114849018c21 WatchSource:0}: Error finding container 113ca7f81fd797f27376c6bf7de65ed5a18d8470904d71a4fb40114849018c21: Status 404 returned error can't find the container with id 113ca7f81fd797f27376c6bf7de65ed5a18d8470904d71a4fb40114849018c21 Jun 08 18:21:38.151779 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:38.151750 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-9vf8s" Jun 08 18:21:38.219055 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:38.219015 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2a8d57ea-6ae9-425d-96bf-8cb9eba30606","Type":"ContainerStarted","Data":"7920ad08dddefb702a2981f8804a991166ba28bd528cc15ab4a0f7792c60ed6c"} Jun 08 18:21:38.219270 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:38.219084 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"2a8d57ea-6ae9-425d-96bf-8cb9eba30606","Type":"ContainerStarted","Data":"113ca7f81fd797f27376c6bf7de65ed5a18d8470904d71a4fb40114849018c21"} Jun 08 18:21:38.239760 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:38.239699 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.939583119 podStartE2EDuration="1.239676882s" totalImagesPullingTime="300.093763ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:21:38.236879341 +0000 UTC m=+855.333378812" watchObservedRunningTime="2026-06-08 18:21:38.239676882 +0000 UTC m=+855.336176362" Jun 08 18:21:38.582438 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:38.582390 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 18:21:38.583893 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:38.583853 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2a8d57ea-6ae9-425d-96bf-8cb9eba30606" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 08 18:21:39.582864 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:39.582805 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2a8d57ea-6ae9-425d-96bf-8cb9eba30606" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 08 18:21:40.582082 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:40.582030 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2a8d57ea-6ae9-425d-96bf-8cb9eba30606" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 08 18:21:41.582739 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:41.582686 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2a8d57ea-6ae9-425d-96bf-8cb9eba30606" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 08 18:21:42.583339 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:42.582853 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2a8d57ea-6ae9-425d-96bf-8cb9eba30606" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 08 18:21:43.583020 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:43.582968 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2a8d57ea-6ae9-425d-96bf-8cb9eba30606" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 08 18:21:44.582285 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:44.582231 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2a8d57ea-6ae9-425d-96bf-8cb9eba30606" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 08 18:21:45.296982 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:45.296936 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:21:45.582269 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:45.582165 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2a8d57ea-6ae9-425d-96bf-8cb9eba30606" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 08 18:21:46.582466 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:46.582420 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2a8d57ea-6ae9-425d-96bf-8cb9eba30606" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 08 18:21:47.582590 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:47.582536 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 18:21:47.583113 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:47.582904 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2a8d57ea-6ae9-425d-96bf-8cb9eba30606" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 08 18:21:48.582214 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:48.582168 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2a8d57ea-6ae9-425d-96bf-8cb9eba30606" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 08 18:21:49.582509 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:49.582454 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2a8d57ea-6ae9-425d-96bf-8cb9eba30606" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 08 18:21:50.582805 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:50.582763 2556 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="2a8d57ea-6ae9-425d-96bf-8cb9eba30606" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Jun 08 18:21:51.680272 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:51.680235 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 18:21:51.694039 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:21:51.693987 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="2a8d57ea-6ae9-425d-96bf-8cb9eba30606" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 18:22:01.685468 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:01.685414 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="2a8d57ea-6ae9-425d-96bf-8cb9eba30606" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 18:22:11.686539 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:11.686486 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 18:22:23.449437 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:23.449352 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb7h4_b362d30f-bd8d-4a56-ae18-f05ebf4edb01/ovn-acl-logging/0.log" Jun 08 18:22:23.452790 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:23.452768 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb7h4_b362d30f-bd8d-4a56-ae18-f05ebf4edb01/ovn-acl-logging/0.log" Jun 08 18:22:24.251097 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:24.251057 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:22:24.349023 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:24.348980 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:22:30.668766 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.668731 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg"] Jun 08 18:22:30.673651 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.673630 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.676364 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.676343 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-47rx6\"" Jun 08 18:22:30.676493 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.676362 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 18:22:30.676493 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.676362 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 08 18:22:30.677302 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.677268 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 18:22:30.686065 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.686043 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg"] Jun 08 18:22:30.706271 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.706234 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:22:30.803494 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.803457 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d32b5f0a-fcc5-4adc-977b-729c35c0e890-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.803494 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.803497 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkdss\" (UniqueName: \"kubernetes.io/projected/d32b5f0a-fcc5-4adc-977b-729c35c0e890-kube-api-access-gkdss\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.803707 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.803521 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d32b5f0a-fcc5-4adc-977b-729c35c0e890-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.803707 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.803613 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d32b5f0a-fcc5-4adc-977b-729c35c0e890-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.803707 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.803655 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d32b5f0a-fcc5-4adc-977b-729c35c0e890-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.803814 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.803779 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d32b5f0a-fcc5-4adc-977b-729c35c0e890-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.904933 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.904891 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d32b5f0a-fcc5-4adc-977b-729c35c0e890-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.905114 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.904940 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d32b5f0a-fcc5-4adc-977b-729c35c0e890-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.905114 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.905019 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d32b5f0a-fcc5-4adc-977b-729c35c0e890-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.905114 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.905059 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d32b5f0a-fcc5-4adc-977b-729c35c0e890-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.905114 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.905086 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkdss\" (UniqueName: \"kubernetes.io/projected/d32b5f0a-fcc5-4adc-977b-729c35c0e890-kube-api-access-gkdss\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.905331 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.905117 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d32b5f0a-fcc5-4adc-977b-729c35c0e890-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.905429 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.905342 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d32b5f0a-fcc5-4adc-977b-729c35c0e890-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.905517 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.905492 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d32b5f0a-fcc5-4adc-977b-729c35c0e890-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.905517 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.905508 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d32b5f0a-fcc5-4adc-977b-729c35c0e890-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.907391 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.907344 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d32b5f0a-fcc5-4adc-977b-729c35c0e890-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.907659 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.907641 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d32b5f0a-fcc5-4adc-977b-729c35c0e890-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.913718 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.913687 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkdss\" (UniqueName: \"kubernetes.io/projected/d32b5f0a-fcc5-4adc-977b-729c35c0e890-kube-api-access-gkdss\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg\" (UID: \"d32b5f0a-fcc5-4adc-977b-729c35c0e890\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:30.984727 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:30.984685 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:31.124437 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:31.124408 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg"] Jun 08 18:22:31.125469 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:22:31.125441 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32b5f0a_fcc5_4adc_977b_729c35c0e890.slice/crio-fa425bcf32b1ac442da1c5e71afabbfed20c8bdda52821c95938053b5145a893 WatchSource:0}: Error finding container fa425bcf32b1ac442da1c5e71afabbfed20c8bdda52821c95938053b5145a893: Status 404 returned error can't find the container with id fa425bcf32b1ac442da1c5e71afabbfed20c8bdda52821c95938053b5145a893 Jun 08 18:22:31.571599 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:31.571549 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" event={"ID":"d32b5f0a-fcc5-4adc-977b-729c35c0e890","Type":"ContainerStarted","Data":"fa425bcf32b1ac442da1c5e71afabbfed20c8bdda52821c95938053b5145a893"} Jun 08 18:22:36.605025 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:36.604992 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" event={"ID":"d32b5f0a-fcc5-4adc-977b-729c35c0e890","Type":"ContainerStarted","Data":"d929cdca3493fd393ba9355764b33cfdfe0247b45e8669d056c903e077321956"} Jun 08 18:22:37.611920 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:37.611884 2556 generic.go:356] "Generic (PLEG): container finished" podID="d32b5f0a-fcc5-4adc-977b-729c35c0e890" containerID="d929cdca3493fd393ba9355764b33cfdfe0247b45e8669d056c903e077321956" exitCode=0 Jun 08 18:22:37.612350 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:37.611975 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" event={"ID":"d32b5f0a-fcc5-4adc-977b-729c35c0e890","Type":"ContainerDied","Data":"d929cdca3493fd393ba9355764b33cfdfe0247b45e8669d056c903e077321956"} Jun 08 18:22:37.612481 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:37.612466 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 18:22:39.626918 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:39.626884 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" event={"ID":"d32b5f0a-fcc5-4adc-977b-729c35c0e890","Type":"ContainerStarted","Data":"49d8d891077803ce027baea105a861afe391b07e54508f219a6ae3ef084d34b7"} Jun 08 18:22:39.654424 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:39.654353 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" podStartSLOduration=2.7358555239999998 podStartE2EDuration="9.654335805s" totalImagesPullingTime="5.644058943s" totalInitContainerRuntime="1.274421338s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:22:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:22:39.651256509 +0000 UTC m=+916.747755979" watchObservedRunningTime="2026-06-08 18:22:39.654335805 +0000 UTC m=+916.750835274" Jun 08 18:22:40.985247 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:40.985206 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:40.985700 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:40.985268 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:40.997954 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:40.997930 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:41.650660 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:41.650625 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg" Jun 08 18:22:42.447553 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:42.447519 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:22:55.580242 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.580205 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf"] Jun 08 18:22:55.641808 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.641771 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:22:55.741620 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.741580 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf"] Jun 08 18:22:55.741797 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.741707 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.746360 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.746330 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 08 18:22:55.839850 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.839751 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2974f217-ae42-46f4-905b-cacd0c5c2299-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.839850 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.839793 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2974f217-ae42-46f4-905b-cacd0c5c2299-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.839850 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.839833 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2974f217-ae42-46f4-905b-cacd0c5c2299-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.840142 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.839913 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2974f217-ae42-46f4-905b-cacd0c5c2299-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.840142 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.839974 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2974f217-ae42-46f4-905b-cacd0c5c2299-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.840142 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.840025 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg4kc\" (UniqueName: \"kubernetes.io/projected/2974f217-ae42-46f4-905b-cacd0c5c2299-kube-api-access-gg4kc\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.940641 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.940588 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2974f217-ae42-46f4-905b-cacd0c5c2299-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.940641 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.940642 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2974f217-ae42-46f4-905b-cacd0c5c2299-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.940906 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.940686 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2974f217-ae42-46f4-905b-cacd0c5c2299-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.940906 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.940721 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2974f217-ae42-46f4-905b-cacd0c5c2299-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.940906 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.940865 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2974f217-ae42-46f4-905b-cacd0c5c2299-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.941064 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.940949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg4kc\" (UniqueName: \"kubernetes.io/projected/2974f217-ae42-46f4-905b-cacd0c5c2299-kube-api-access-gg4kc\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.941124 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.941104 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2974f217-ae42-46f4-905b-cacd0c5c2299-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.941182 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.941129 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/2974f217-ae42-46f4-905b-cacd0c5c2299-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.941224 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.941183 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2974f217-ae42-46f4-905b-cacd0c5c2299-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.942929 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.942908 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2974f217-ae42-46f4-905b-cacd0c5c2299-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.943197 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.943180 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2974f217-ae42-46f4-905b-cacd0c5c2299-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:55.950390 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:55.950352 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg4kc\" (UniqueName: \"kubernetes.io/projected/2974f217-ae42-46f4-905b-cacd0c5c2299-kube-api-access-gg4kc\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf\" (UID: \"2974f217-ae42-46f4-905b-cacd0c5c2299\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:56.052270 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:56.052226 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:22:56.224489 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:56.224461 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf"] Jun 08 18:22:56.225301 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:22:56.225269 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2974f217_ae42_46f4_905b_cacd0c5c2299.slice/crio-06aee9a1cae6fe37d66c827f6b97c743c167813075a6df55c934a859698d10ce WatchSource:0}: Error finding container 06aee9a1cae6fe37d66c827f6b97c743c167813075a6df55c934a859698d10ce: Status 404 returned error can't find the container with id 06aee9a1cae6fe37d66c827f6b97c743c167813075a6df55c934a859698d10ce Jun 08 18:22:56.728274 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:56.728236 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" event={"ID":"2974f217-ae42-46f4-905b-cacd0c5c2299","Type":"ContainerStarted","Data":"de3f0de0827db26c3072c4bb7cf9d8c19ce5631d5fc3f5ff808f6ac19b937126"} Jun 08 18:22:56.728918 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:56.728290 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" event={"ID":"2974f217-ae42-46f4-905b-cacd0c5c2299","Type":"ContainerStarted","Data":"06aee9a1cae6fe37d66c827f6b97c743c167813075a6df55c934a859698d10ce"} Jun 08 18:22:57.735852 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:57.735811 2556 generic.go:356] "Generic (PLEG): container finished" podID="2974f217-ae42-46f4-905b-cacd0c5c2299" containerID="de3f0de0827db26c3072c4bb7cf9d8c19ce5631d5fc3f5ff808f6ac19b937126" exitCode=0 Jun 08 18:22:57.736251 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:57.735902 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" event={"ID":"2974f217-ae42-46f4-905b-cacd0c5c2299","Type":"ContainerDied","Data":"de3f0de0827db26c3072c4bb7cf9d8c19ce5631d5fc3f5ff808f6ac19b937126"} Jun 08 18:22:58.747026 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:58.746991 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" event={"ID":"2974f217-ae42-46f4-905b-cacd0c5c2299","Type":"ContainerStarted","Data":"c452470d1a16d6ca7ec91861d0d10c2c0217e39d7d303877d8864b68d24d23f0"} Jun 08 18:22:58.771242 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:22:58.771194 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" podStartSLOduration=2.278809287 podStartE2EDuration="3.771177751s" totalImagesPullingTime="229.096609ms" totalInitContainerRuntime="1.263271855s" isStatefulPod=false podCreationTimestamp="2026-06-08 18:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:22:58.768255211 +0000 UTC m=+935.864754683" watchObservedRunningTime="2026-06-08 18:22:58.771177751 +0000 UTC m=+935.867677220" Jun 08 18:23:00.700099 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:23:00.700058 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:23:06.052852 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:23:06.052811 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:23:06.053339 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:23:06.052895 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:23:06.065265 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:23:06.065238 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:23:06.806818 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:23:06.806783 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf" Jun 08 18:23:17.549160 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:23:17.549125 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:23:27.141369 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:23:27.141333 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:23:36.175895 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:23:36.175856 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:24:41.916530 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:24:41.916491 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:25:12.538823 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:25:12.538784 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:25:42.889446 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:25:42.889404 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:26:56.048041 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:26:56.047952 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:26:56.111402 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:26:56.111341 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:27:23.495745 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:23.495716 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb7h4_b362d30f-bd8d-4a56-ae18-f05ebf4edb01/ovn-acl-logging/0.log" Jun 08 18:27:23.500753 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:23.500727 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb7h4_b362d30f-bd8d-4a56-ae18-f05ebf4edb01/ovn-acl-logging/0.log" Jun 08 18:27:33.207636 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:33.207606 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-698f967485-ttqvs_2e0a7774-da9d-428a-94e8-604ca5e14446/nginx/0.log" Jun 08 18:27:33.684387 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:33.684339 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-67b9f5697d-b5lss_e5a5d5af-fc02-464b-ba8e-5586dd080851/maas-api/0.log" Jun 08 18:27:33.803976 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:33.803943 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56df96974c-4lhps_63cf068c-2d9c-4d3f-99a1-1cb353eddeb1/manager/0.log" Jun 08 18:27:34.153271 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:34.153242 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-794487f99d-59ghd_fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2/copy-manifests/0.log" Jun 08 18:27:34.160749 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:34.160722 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-794487f99d-59ghd_fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2/manager/0.log" Jun 08 18:27:35.317354 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:35.317319 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q_fd1f5632-a42c-4973-8800-2b4b0a9b7f80/util/0.log" Jun 08 18:27:35.325628 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:35.325594 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q_fd1f5632-a42c-4973-8800-2b4b0a9b7f80/pull/0.log" Jun 08 18:27:35.334811 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:35.334787 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q_fd1f5632-a42c-4973-8800-2b4b0a9b7f80/extract/0.log" Jun 08 18:27:35.446258 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:35.446231 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6_8e51df07-bd72-4297-ad99-890f2c0bbaf9/util/0.log" Jun 08 18:27:35.453219 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:35.453189 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6_8e51df07-bd72-4297-ad99-890f2c0bbaf9/pull/0.log" Jun 08 18:27:35.462031 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:35.462005 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6_8e51df07-bd72-4297-ad99-890f2c0bbaf9/extract/0.log" Jun 08 18:27:35.570367 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:35.570289 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd_0add1f90-e8d3-4d81-8731-d49f638040ab/util/0.log" Jun 08 18:27:35.578631 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:35.578610 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd_0add1f90-e8d3-4d81-8731-d49f638040ab/pull/0.log" Jun 08 18:27:35.586678 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:35.586655 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd_0add1f90-e8d3-4d81-8731-d49f638040ab/extract/0.log" Jun 08 18:27:35.705904 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:35.705873 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb_0d395ca2-dbad-45f0-b7b9-6824e71bdea4/pull/0.log" Jun 08 18:27:35.722734 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:35.722705 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb_0d395ca2-dbad-45f0-b7b9-6824e71bdea4/extract/0.log" Jun 08 18:27:35.735210 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:35.735186 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb_0d395ca2-dbad-45f0-b7b9-6824e71bdea4/util/0.log" Jun 08 18:27:36.008910 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:36.008875 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dvmgr_b8c4562f-f60e-4d6a-8b69-7288fa7a32f1/manager/0.log" Jun 08 18:27:36.373785 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:36.373682 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qcvjn_5456004e-5dfe-4c10-a8cd-b66d164bb592/registry-server/0.log" Jun 08 18:27:36.753423 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:36.753392 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vwxsh_20e192f0-bc54-4617-94bd-177643218404/manager/0.log" Jun 08 18:27:37.109461 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:37.109362 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795rx46p_ce148473-f083-4816-b418-e289da63284d/istio-proxy/0.log" Jun 08 18:27:37.583937 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:37.583892 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-jxhww_002f6d8f-7434-4958-ace4-95c6a095bf18/istio-proxy/1.log" Jun 08 18:27:37.695038 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:37.695005 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-9vf8s_73568bf2-098c-4325-ad00-2b890068697b/payload-pre-processing/0.log" Jun 08 18:27:38.262923 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:38.262872 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg_d32b5f0a-fcc5-4adc-977b-729c35c0e890/storage-initializer/0.log" Jun 08 18:27:38.275125 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:38.275086 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-kqckg_d32b5f0a-fcc5-4adc-977b-729c35c0e890/main/0.log" Jun 08 18:27:38.509728 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:38.509698 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf_2974f217-ae42-46f4-905b-cacd0c5c2299/storage-initializer/0.log" Jun 08 18:27:38.531132 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:38.531020 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-wl2gf_2974f217-ae42-46f4-905b-cacd0c5c2299/main/0.log" Jun 08 18:27:42.616056 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:42.616017 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:27:42.701505 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:42.701466 2556 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" limit=1024 Jun 08 18:27:45.681576 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:45.681542 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-67m2r_d0802022-961e-47d3-9708-d92ba53c576c/global-pull-secret-syncer/0.log" Jun 08 18:27:45.947359 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:45.947252 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2qjjd_e41bc240-74f7-4b2f-9227-74de729c6c28/konnectivity-agent/0.log" Jun 08 18:27:46.088964 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:46.088931 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-216.ec2.internal_5ed76c772cacd8817bd3f93664e5f5f7/haproxy/0.log" Jun 08 18:27:50.286355 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:50.286321 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q_fd1f5632-a42c-4973-8800-2b4b0a9b7f80/extract/0.log" Jun 08 18:27:50.326277 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:50.326242 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q_fd1f5632-a42c-4973-8800-2b4b0a9b7f80/util/0.log" Jun 08 18:27:50.356628 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:50.356601 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759smr6q_fd1f5632-a42c-4973-8800-2b4b0a9b7f80/pull/0.log" Jun 08 18:27:50.423106 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:50.423067 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6_8e51df07-bd72-4297-ad99-890f2c0bbaf9/extract/0.log" Jun 08 18:27:50.475399 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:50.475338 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6_8e51df07-bd72-4297-ad99-890f2c0bbaf9/util/0.log" Jun 08 18:27:50.536507 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:50.536401 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jdmp6_8e51df07-bd72-4297-ad99-890f2c0bbaf9/pull/0.log" Jun 08 18:27:50.608198 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:50.608172 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd_0add1f90-e8d3-4d81-8731-d49f638040ab/extract/0.log" Jun 08 18:27:50.681523 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:50.681488 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd_0add1f90-e8d3-4d81-8731-d49f638040ab/util/0.log" Jun 08 18:27:50.737002 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:50.736976 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73hkbsd_0add1f90-e8d3-4d81-8731-d49f638040ab/pull/0.log" Jun 08 18:27:50.784490 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:50.784452 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb_0d395ca2-dbad-45f0-b7b9-6824e71bdea4/extract/0.log" Jun 08 18:27:50.824414 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:50.824311 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb_0d395ca2-dbad-45f0-b7b9-6824e71bdea4/util/0.log" Jun 08 18:27:50.862988 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:50.862958 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1lj8mb_0d395ca2-dbad-45f0-b7b9-6824e71bdea4/pull/0.log" Jun 08 18:27:50.946184 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:50.946151 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dvmgr_b8c4562f-f60e-4d6a-8b69-7288fa7a32f1/manager/0.log" Jun 08 18:27:51.098234 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:51.098140 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-qcvjn_5456004e-5dfe-4c10-a8cd-b66d164bb592/registry-server/0.log" Jun 08 18:27:51.263856 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:51.263823 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-vwxsh_20e192f0-bc54-4617-94bd-177643218404/manager/0.log" Jun 08 18:27:53.194000 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:53.193968 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae6b7a7d-8e22-4151-87e1-c980116d1198/alertmanager/0.log" Jun 08 18:27:53.233743 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:53.233712 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae6b7a7d-8e22-4151-87e1-c980116d1198/config-reloader/0.log" Jun 08 18:27:53.267531 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:53.267500 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae6b7a7d-8e22-4151-87e1-c980116d1198/kube-rbac-proxy-web/0.log" Jun 08 18:27:53.299055 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:53.299026 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae6b7a7d-8e22-4151-87e1-c980116d1198/kube-rbac-proxy/0.log" Jun 08 18:27:53.331668 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:53.331638 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae6b7a7d-8e22-4151-87e1-c980116d1198/kube-rbac-proxy-metric/0.log" Jun 08 18:27:53.357484 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:53.357456 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae6b7a7d-8e22-4151-87e1-c980116d1198/prom-label-proxy/0.log" Jun 08 18:27:53.381071 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:53.381037 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ae6b7a7d-8e22-4151-87e1-c980116d1198/init-config-reloader/0.log" Jun 08 18:27:53.426131 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:53.426039 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-7qckw_76e1a31b-3e39-472f-a4ef-9d53ebc7a59a/cluster-monitoring-operator/0.log" Jun 08 18:27:53.720610 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:53.720578 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m7drh_27b4f0b9-6f8a-4a49-915e-caceadda0c50/node-exporter/0.log" Jun 08 18:27:53.747942 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:53.747915 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m7drh_27b4f0b9-6f8a-4a49-915e-caceadda0c50/kube-rbac-proxy/0.log" Jun 08 18:27:53.770324 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:53.770278 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m7drh_27b4f0b9-6f8a-4a49-915e-caceadda0c50/init-textfile/0.log" Jun 08 18:27:53.901152 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:53.901125 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-ljzjd_d9469b18-3b27-4af4-bc1e-88b7ac5b9d17/kube-rbac-proxy-main/0.log" Jun 08 18:27:53.926151 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:53.926118 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-ljzjd_d9469b18-3b27-4af4-bc1e-88b7ac5b9d17/kube-rbac-proxy-self/0.log" Jun 08 18:27:53.951226 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:53.951194 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-ljzjd_d9469b18-3b27-4af4-bc1e-88b7ac5b9d17/openshift-state-metrics/0.log" Jun 08 18:27:54.205338 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:54.205241 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-sdccp_86fedcf7-5765-49b3-b49a-bda367c7f3b9/prometheus-operator/0.log" Jun 08 18:27:54.226936 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:54.226910 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-sdccp_86fedcf7-5765-49b3-b49a-bda367c7f3b9/kube-rbac-proxy/0.log" Jun 08 18:27:54.252304 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:54.252274 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-pwfjh_3c7bd69c-d2a2-422b-b3c7-e4666b1c0196/prometheus-operator-admission-webhook/0.log" Jun 08 18:27:55.935861 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:55.935820 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-6mkhq_c61949ce-e85f-4004-be6d-908faafb7aee/networking-console-plugin/0.log" Jun 08 18:27:56.663360 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.663317 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl"] Jun 08 18:27:56.667131 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.667104 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:56.670634 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.670609 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vrx72\"/\"kube-root-ca.crt\"" Jun 08 18:27:56.670806 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.670789 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vrx72\"/\"openshift-service-ca.crt\"" Jun 08 18:27:56.671714 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.671697 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vrx72\"/\"default-dockercfg-k54r7\"" Jun 08 18:27:56.687817 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.687787 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl"] Jun 08 18:27:56.794228 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.794185 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/adfe14ac-40c8-4806-a2a7-82790f3cfabe-sys\") pod \"perf-node-gather-daemonset-qb4dl\" (UID: \"adfe14ac-40c8-4806-a2a7-82790f3cfabe\") " pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:56.794458 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.794264 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/adfe14ac-40c8-4806-a2a7-82790f3cfabe-lib-modules\") pod \"perf-node-gather-daemonset-qb4dl\" (UID: \"adfe14ac-40c8-4806-a2a7-82790f3cfabe\") " pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:56.794458 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.794294 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/adfe14ac-40c8-4806-a2a7-82790f3cfabe-proc\") pod \"perf-node-gather-daemonset-qb4dl\" (UID: \"adfe14ac-40c8-4806-a2a7-82790f3cfabe\") " pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:56.794458 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.794339 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/adfe14ac-40c8-4806-a2a7-82790f3cfabe-podres\") pod \"perf-node-gather-daemonset-qb4dl\" (UID: \"adfe14ac-40c8-4806-a2a7-82790f3cfabe\") " pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:56.794458 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.794411 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm4sp\" (UniqueName: \"kubernetes.io/projected/adfe14ac-40c8-4806-a2a7-82790f3cfabe-kube-api-access-fm4sp\") pod \"perf-node-gather-daemonset-qb4dl\" (UID: \"adfe14ac-40c8-4806-a2a7-82790f3cfabe\") " pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:56.895527 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.895488 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/adfe14ac-40c8-4806-a2a7-82790f3cfabe-podres\") pod \"perf-node-gather-daemonset-qb4dl\" (UID: \"adfe14ac-40c8-4806-a2a7-82790f3cfabe\") " pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:56.895724 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.895541 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm4sp\" (UniqueName: \"kubernetes.io/projected/adfe14ac-40c8-4806-a2a7-82790f3cfabe-kube-api-access-fm4sp\") pod \"perf-node-gather-daemonset-qb4dl\" (UID: \"adfe14ac-40c8-4806-a2a7-82790f3cfabe\") " pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:56.895724 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.895584 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/adfe14ac-40c8-4806-a2a7-82790f3cfabe-sys\") pod \"perf-node-gather-daemonset-qb4dl\" (UID: \"adfe14ac-40c8-4806-a2a7-82790f3cfabe\") " pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:56.895724 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.895631 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/adfe14ac-40c8-4806-a2a7-82790f3cfabe-lib-modules\") pod \"perf-node-gather-daemonset-qb4dl\" (UID: \"adfe14ac-40c8-4806-a2a7-82790f3cfabe\") " pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:56.895724 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.895661 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/adfe14ac-40c8-4806-a2a7-82790f3cfabe-proc\") pod \"perf-node-gather-daemonset-qb4dl\" (UID: \"adfe14ac-40c8-4806-a2a7-82790f3cfabe\") " pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:56.895724 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.895672 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/adfe14ac-40c8-4806-a2a7-82790f3cfabe-podres\") pod \"perf-node-gather-daemonset-qb4dl\" (UID: \"adfe14ac-40c8-4806-a2a7-82790f3cfabe\") " pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:56.895724 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.895717 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/adfe14ac-40c8-4806-a2a7-82790f3cfabe-sys\") pod \"perf-node-gather-daemonset-qb4dl\" (UID: \"adfe14ac-40c8-4806-a2a7-82790f3cfabe\") " pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:56.895953 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.895766 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/adfe14ac-40c8-4806-a2a7-82790f3cfabe-proc\") pod \"perf-node-gather-daemonset-qb4dl\" (UID: \"adfe14ac-40c8-4806-a2a7-82790f3cfabe\") " pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:56.895953 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.895775 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/adfe14ac-40c8-4806-a2a7-82790f3cfabe-lib-modules\") pod \"perf-node-gather-daemonset-qb4dl\" (UID: \"adfe14ac-40c8-4806-a2a7-82790f3cfabe\") " pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:56.904332 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.904303 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm4sp\" (UniqueName: \"kubernetes.io/projected/adfe14ac-40c8-4806-a2a7-82790f3cfabe-kube-api-access-fm4sp\") pod \"perf-node-gather-daemonset-qb4dl\" (UID: \"adfe14ac-40c8-4806-a2a7-82790f3cfabe\") " pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:56.977191 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:56.977160 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:57.118462 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:57.118431 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl"] Jun 08 18:27:57.119488 ip-10-0-140-216 kubenswrapper[2556]: W0608 18:27:57.119456 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podadfe14ac_40c8_4806_a2a7_82790f3cfabe.slice/crio-785863970af6cc05e9089198080bbeba1439c882e45f0d5d1e2d22be73ef59d7 WatchSource:0}: Error finding container 785863970af6cc05e9089198080bbeba1439c882e45f0d5d1e2d22be73ef59d7: Status 404 returned error can't find the container with id 785863970af6cc05e9089198080bbeba1439c882e45f0d5d1e2d22be73ef59d7 Jun 08 18:27:57.474903 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:57.474863 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" event={"ID":"adfe14ac-40c8-4806-a2a7-82790f3cfabe","Type":"ContainerStarted","Data":"6f8a4dbe9602dedb6af0d40eb86b50d4f69fbcfa4c84edf9f64b3af45afaaec8"} Jun 08 18:27:57.475105 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:57.474926 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" event={"ID":"adfe14ac-40c8-4806-a2a7-82790f3cfabe","Type":"ContainerStarted","Data":"785863970af6cc05e9089198080bbeba1439c882e45f0d5d1e2d22be73ef59d7"} Jun 08 18:27:57.475105 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:57.474966 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:27:57.508749 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:57.508700 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" podStartSLOduration=1.5086844689999999 podStartE2EDuration="1.508684469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 18:27:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 18:27:57.508574717 +0000 UTC m=+1234.605074188" watchObservedRunningTime="2026-06-08 18:27:57.508684469 +0000 UTC m=+1234.605183965" Jun 08 18:27:59.308317 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:59.308288 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f2b89_b86ecae8-ac1d-4eb0-b49f-3b62e30cc190/dns/0.log" Jun 08 18:27:59.333771 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:59.333743 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f2b89_b86ecae8-ac1d-4eb0-b49f-3b62e30cc190/kube-rbac-proxy/0.log" Jun 08 18:27:59.420066 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:27:59.420032 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9fxrg_19721b88-ef0f-45e3-bbb2-5617aaeee3b5/dns-node-resolver/0.log" Jun 08 18:28:00.145251 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:00.145214 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-68pd6_33e0074d-ecf4-4562-892c-c1a812e17ea2/node-ca/0.log" Jun 08 18:28:01.223351 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:01.223317 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795rx46p_ce148473-f083-4816-b418-e289da63284d/istio-proxy/0.log" Jun 08 18:28:01.356165 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:01.356116 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-jxhww_002f6d8f-7434-4958-ace4-95c6a095bf18/istio-proxy/1.log" Jun 08 18:28:01.356861 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:01.356808 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-jxhww_002f6d8f-7434-4958-ace4-95c6a095bf18/istio-proxy/0.log" Jun 08 18:28:01.377961 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:01.377919 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-9vf8s_73568bf2-098c-4325-ad00-2b890068697b/payload-pre-processing/0.log" Jun 08 18:28:02.118013 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:02.117982 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t7hm6_0de14d23-338d-40ba-a6c5-99db292ddb6d/serve-healthcheck-canary/0.log" Jun 08 18:28:03.064730 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:03.064698 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sr92g_d0ccd296-0440-4035-824b-a99b3499101d/kube-rbac-proxy/0.log" Jun 08 18:28:03.118789 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:03.118748 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sr92g_d0ccd296-0440-4035-824b-a99b3499101d/exporter/0.log" Jun 08 18:28:03.192707 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:03.192678 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sr92g_d0ccd296-0440-4035-824b-a99b3499101d/extractor/0.log" Jun 08 18:28:03.491697 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:03.491667 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vrx72/perf-node-gather-daemonset-qb4dl" Jun 08 18:28:05.980622 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:05.980594 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-698f967485-ttqvs_2e0a7774-da9d-428a-94e8-604ca5e14446/nginx/0.log" Jun 08 18:28:06.127981 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:06.127946 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-67b9f5697d-b5lss_e5a5d5af-fc02-464b-ba8e-5586dd080851/maas-api/0.log" Jun 08 18:28:06.170150 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:06.170121 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-56df96974c-4lhps_63cf068c-2d9c-4d3f-99a1-1cb353eddeb1/manager/0.log" Jun 08 18:28:06.288309 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:06.288173 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-794487f99d-59ghd_fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2/manager/0.log" Jun 08 18:28:06.317795 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:06.317772 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-794487f99d-59ghd_fc90f6f6-bb0a-48e5-9a51-e7a8f36e84d2/copy-manifests/0.log" Jun 08 18:28:08.242154 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:08.242117 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-59f576b8b8-jghh5_d0c4406e-1f86-4ccf-9920-4a9a5579cf88/manager/0.log" Jun 08 18:28:10.968394 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:10.968344 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795rx46p_ce148473-f083-4816-b418-e289da63284d/istio-proxy/0.log" Jun 08 18:28:11.070267 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:11.070235 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-jxhww_002f6d8f-7434-4958-ace4-95c6a095bf18/istio-proxy/1.log" Jun 08 18:28:11.070706 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:11.070692 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-jxhww_002f6d8f-7434-4958-ace4-95c6a095bf18/istio-proxy/0.log" Jun 08 18:28:11.080656 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:11.080629 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-9vf8s_73568bf2-098c-4325-ad00-2b890068697b/payload-pre-processing/0.log" Jun 08 18:28:12.213273 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:12.213237 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795rx46p_ce148473-f083-4816-b418-e289da63284d/istio-proxy/0.log" Jun 08 18:28:12.305430 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:12.305400 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-jxhww_002f6d8f-7434-4958-ace4-95c6a095bf18/istio-proxy/1.log" Jun 08 18:28:12.306071 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:12.306021 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-jxhww_002f6d8f-7434-4958-ace4-95c6a095bf18/istio-proxy/0.log" Jun 08 18:28:12.320775 ip-10-0-140-216 kubenswrapper[2556]: I0608 18:28:12.320753 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-9vf8s_73568bf2-098c-4325-ad00-2b890068697b/payload-pre-processing/0.log"