Jul 10 20:19:06.537217 ip-10-0-133-6 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 10 20:19:06.537226 ip-10-0-133-6 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 10 20:19:06.537233 ip-10-0-133-6 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 10 20:19:06.537437 ip-10-0-133-6 systemd[1]: Failed to start Kubernetes Kubelet. Jul 10 20:19:16.549330 ip-10-0-133-6 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 10 20:19:16.549346 ip-10-0-133-6 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot f2498118a7ca48bfa024fb9c79117f67 -- Jul 10 20:21:17.166242 ip-10-0-133-6 systemd[1]: Starting Kubernetes Kubelet... Jul 10 20:21:19.383138 ip-10-0-133-6 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 20:21:19.383138 ip-10-0-133-6 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 20:21:19.383138 ip-10-0-133-6 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 20:21:19.383138 ip-10-0-133-6 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 20:21:19.383138 ip-10-0-133-6 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 20:21:19.383798 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.383210 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 20:21:19.390248 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390229 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:21:19.390248 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390246 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:21:19.390248 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390250 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390254 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390257 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390261 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390264 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390268 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390272 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390276 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390278 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390282 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390285 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390288 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390291 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390293 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390296 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390299 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390302 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390304 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390307 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390309 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:21:19.390341 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390312 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390314 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390317 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390319 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390322 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390329 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390332 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390334 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390337 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390339 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390343 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390345 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390348 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390351 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390354 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390358 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390360 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390363 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390366 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390368 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:21:19.390789 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390371 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390373 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390376 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390380 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390383 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390385 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390388 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390391 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390394 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390396 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390400 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390404 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390407 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390410 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390413 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390416 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390419 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390422 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390424 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:21:19.391274 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390427 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390430 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390432 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390435 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390437 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390440 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390442 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390445 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390447 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390450 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390452 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390454 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390457 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390459 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390462 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390464 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390466 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390469 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390472 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:21:19.391718 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390476 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390478 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390481 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390483 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390486 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390488 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390491 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390495 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390498 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390501 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390503 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390506 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390509 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390511 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390514 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390516 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390519 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390521 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.390524 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391236 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:21:19.392209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391243 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391246 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391249 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391252 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391254 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391257 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391260 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391262 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391265 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391267 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391273 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391276 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391279 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391282 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391285 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391288 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391290 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391293 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391296 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391299 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:21:19.392677 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391302 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391305 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391307 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391310 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391312 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391315 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391318 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391320 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391323 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391325 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391328 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391330 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391333 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391336 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391338 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391341 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391343 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391346 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391348 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391351 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:21:19.393189 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391354 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391358 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391362 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391365 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391368 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391371 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391374 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391377 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391380 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391382 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391385 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391389 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391393 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391396 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391399 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391402 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391406 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391409 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391412 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:21:19.393662 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391415 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391418 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391421 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391424 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391426 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391429 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391432 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391434 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391437 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391439 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391442 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391444 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391447 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391449 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391451 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391454 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391457 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391459 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391462 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:21:19.394112 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391464 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391467 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391469 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391471 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391474 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391477 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391480 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391482 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391484 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391487 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391490 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391492 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391495 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391497 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391499 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391502 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391504 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391507 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391509 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391512 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:21:19.394582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391944 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391950 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391953 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391956 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391960 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391963 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391965 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391968 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391974 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391976 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391980 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391983 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391986 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391988 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391991 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391994 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391997 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.391999 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392003 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392005 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:21:19.395055 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392008 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392010 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392013 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392015 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392018 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392021 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392023 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392026 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392028 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392031 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392033 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392036 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392038 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392041 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392043 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392045 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392048 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392050 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392053 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392055 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:21:19.395542 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392061 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392064 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392066 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392074 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392077 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392080 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392082 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392085 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392090 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392093 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392095 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392098 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392100 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392103 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392106 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392108 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392110 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392113 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392115 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:21:19.396007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392117 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392120 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392123 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392140 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392143 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392145 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392148 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392150 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392153 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392155 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392159 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392162 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392166 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392170 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392173 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392176 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392178 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392187 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392190 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:21:19.396463 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392193 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392196 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392198 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392201 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392203 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392206 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392209 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392211 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392214 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392216 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392219 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392222 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392225 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392227 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392230 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392232 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392234 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392238 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392241 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:21:19.396956 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392244 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392246 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392312 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392319 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392325 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392329 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392333 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392338 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392342 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392346 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392349 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392354 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392359 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392363 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392366 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392369 2580 flags.go:64] FLAG: --cgroup-root="" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392372 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392375 2580 flags.go:64] FLAG: --client-ca-file="" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392378 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392381 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392386 2580 flags.go:64] FLAG: --cluster-domain="" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392389 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392392 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392395 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 20:21:19.397417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392398 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392402 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392405 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392408 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392411 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392414 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392417 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392420 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392424 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392426 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392430 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392433 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392436 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392439 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392442 2580 flags.go:64] FLAG: --enable-server="true" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392445 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392450 2580 flags.go:64] FLAG: --event-burst="100" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392453 2580 flags.go:64] FLAG: --event-qps="50" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392456 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392460 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392463 2580 flags.go:64] FLAG: --eviction-hard="" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392468 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392471 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392474 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392477 2580 flags.go:64] FLAG: --eviction-soft="" Jul 10 20:21:19.397968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392480 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392483 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392486 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392489 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392492 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392494 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392497 2580 flags.go:64] FLAG: --feature-gates="" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392501 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392504 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392507 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392510 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392513 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392516 2580 flags.go:64] FLAG: --help="false" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392519 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-133-6.ec2.internal" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392522 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392525 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392528 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392531 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392535 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392537 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392540 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392543 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392546 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 20:21:19.398565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392549 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392553 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392556 2580 flags.go:64] FLAG: --kube-reserved="" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392560 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392563 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392566 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392570 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392573 2580 flags.go:64] FLAG: --lock-file="" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392576 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392579 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392581 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392587 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392589 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392592 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392595 2580 flags.go:64] FLAG: --logging-format="text" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392598 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392601 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392604 2580 flags.go:64] FLAG: --manifest-url="" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392607 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392612 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392615 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392619 2580 flags.go:64] FLAG: --max-pods="110" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392622 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392625 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392628 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 20:21:19.399198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392631 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392634 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392637 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392640 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392646 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392649 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392652 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392655 2580 flags.go:64] FLAG: --pod-cidr="" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392658 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392663 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392666 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392670 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392673 2580 flags.go:64] FLAG: --port="10250" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392676 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392680 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02b082edb388b4b4e" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392683 2580 flags.go:64] FLAG: --qos-reserved="" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392686 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392689 2580 flags.go:64] FLAG: --register-node="true" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392692 2580 flags.go:64] FLAG: --register-with-taints="" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392699 2580 flags.go:64] FLAG: --registry-burst="10" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392702 2580 flags.go:64] FLAG: --registry-qps="5" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392705 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392708 2580 flags.go:64] FLAG: --reserved-memory="" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392711 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392714 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 20:21:19.400264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392717 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392720 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392722 2580 flags.go:64] FLAG: --runonce="false" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392725 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392728 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392731 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392734 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392737 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392740 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392743 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392746 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392748 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392754 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392757 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392759 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392762 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392765 2580 flags.go:64] FLAG: --system-cgroups="" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392768 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392775 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392778 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392781 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392785 2580 flags.go:64] FLAG: --tls-min-version="" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392788 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392791 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392794 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 20:21:19.401368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392797 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392815 2580 flags.go:64] FLAG: --v="2" Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392820 2580 flags.go:64] FLAG: --version="false" Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392824 2580 flags.go:64] FLAG: --vmodule="" Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392828 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.392831 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392960 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392965 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392968 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392971 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392974 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392977 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392979 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392982 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392985 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392987 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392989 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392993 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.392997 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393001 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393004 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:21:19.402214 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393006 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393009 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393012 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393014 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393019 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393021 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393024 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393027 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393029 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393032 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393035 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393038 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393040 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393043 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393045 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393048 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393050 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393053 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393055 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393058 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:21:19.402842 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393060 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393063 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393065 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393068 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393070 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393073 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393075 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393078 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393080 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393082 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393090 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393094 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393097 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393099 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393102 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393105 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393109 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393111 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393114 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393116 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:21:19.403719 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393119 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393122 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393137 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393140 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393143 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393146 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393149 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393151 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393154 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393157 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393159 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393162 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393164 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393166 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393169 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393171 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393174 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393177 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393179 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393182 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:21:19.404457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393184 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393187 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393191 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393194 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393197 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393199 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393202 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393205 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393208 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393211 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393215 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393219 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393221 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393224 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393227 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393230 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393232 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393234 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393237 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:21:19.405123 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393239 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:21:19.405923 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393242 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:21:19.405923 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393244 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:21:19.405923 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393247 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:21:19.405923 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.393249 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:21:19.405923 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.393868 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 20:21:19.405923 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.401731 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 20:21:19.405923 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.401751 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 20:21:19.405923 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.402598 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 20:21:19.405923 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.402612 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 20:21:19.405923 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402707 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:21:19.405923 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402716 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:21:19.405923 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402723 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:21:19.405923 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402729 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:21:19.405923 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402734 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:21:19.405923 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402738 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402743 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402748 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402754 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402760 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402766 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402771 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402775 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402779 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402786 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402791 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402796 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402801 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402815 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402820 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402825 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402829 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402833 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402837 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:21:19.406571 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402841 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402845 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402849 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402853 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402860 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402865 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402869 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402874 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402878 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402883 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402887 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402891 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402895 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402900 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402905 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402909 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402913 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402918 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402922 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402935 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:21:19.407209 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402939 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402943 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402948 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402952 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402956 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402960 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402964 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402976 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402980 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402989 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402993 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.402998 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403001 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403006 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403011 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403015 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403020 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403025 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403030 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403034 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:21:19.407747 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403038 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403042 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403047 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403051 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403055 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403059 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403063 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403068 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403072 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403076 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403080 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403084 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403089 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403093 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403097 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403102 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403106 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403110 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403114 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403118 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:21:19.408253 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403147 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:21:19.408764 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403153 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:21:19.408764 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403158 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:21:19.408764 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403162 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:21:19.408764 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403166 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:21:19.408764 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403170 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:21:19.408764 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403175 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:21:19.408764 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403180 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:21:19.408764 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403183 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:21:19.408764 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403188 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:21:19.408764 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403192 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:21:19.408764 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403196 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:21:19.408764 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403200 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:21:19.408764 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403204 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:21:19.408764 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403209 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:21:19.409108 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.403217 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 20:21:19.409108 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403448 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 20:21:19.409108 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403457 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 20:21:19.409108 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403461 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 20:21:19.409108 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403465 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 20:21:19.409108 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403470 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 20:21:19.409108 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403477 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 20:21:19.409108 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403483 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 20:21:19.409108 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403488 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 20:21:19.409108 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403494 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 20:21:19.409108 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403500 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 20:21:19.409108 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403504 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 20:21:19.409108 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403509 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 20:21:19.409108 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403514 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403518 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403523 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403527 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403532 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403551 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403556 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403561 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403565 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403569 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403573 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403577 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403582 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403586 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403590 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403594 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403598 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403603 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403607 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403611 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 20:21:19.409457 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403615 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403619 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403623 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403627 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403631 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403635 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403639 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403643 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403648 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403652 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403656 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403661 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403665 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403669 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403673 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403677 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403681 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403685 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403697 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 20:21:19.409939 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403702 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403706 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403710 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403714 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403718 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403723 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403727 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403731 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403734 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403738 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403742 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403746 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403750 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403754 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403758 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403763 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403767 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403771 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403775 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403779 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 20:21:19.410416 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403783 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403787 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403791 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403796 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403800 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403804 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403808 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403813 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403817 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403822 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403826 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403830 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403841 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403847 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403851 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403855 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403859 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403865 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403871 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403877 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 20:21:19.410892 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403882 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 10 20:21:19.411401 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403886 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 20:21:19.411401 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403891 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 20:21:19.411401 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403895 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 20:21:19.411401 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403899 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 20:21:19.411401 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403903 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 20:21:19.411401 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403908 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 20:21:19.411401 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:19.403912 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 20:21:19.411401 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.403920 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 20:21:19.411401 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.404082 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 20:21:19.411401 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.406939 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 20:21:19.411401 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.408596 2580 server.go:1019] "Starting client certificate rotation" Jul 10 20:21:19.411401 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.408700 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 20:21:19.411401 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.408759 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 20:21:19.411723 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.411459 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 20:21:19.412836 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.412818 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 20:21:19.422242 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.422222 2580 log.go:25] "Validated CRI v1 runtime API" Jul 10 20:21:19.426007 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.425987 2580 log.go:25] "Validated CRI v1 image API" Jul 10 20:21:19.426846 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.426833 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 20:21:19.432298 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.432276 2580 fs.go:135] Filesystem UUIDs: map[12eb0a89-d67f-48c8-8063-4dff2e1d6dea:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8b1cdbfe-fada-4892-ad40-32c8a0d680d0:/dev/nvme0n1p3] Jul 10 20:21:19.432378 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.432295 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 20:21:19.435627 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.435610 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 20:21:19.437539 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.437423 2580 manager.go:216] Machine: {Timestamp:2026-07-10 20:21:19.436111596 +0000 UTC m=+0.896316419 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099888 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2670c02ce8fc8f2fa67efd7de907c8 SystemUUID:ec2670c0-2ce8-fc8f-2fa6-7efd7de907c8 BootID:f2498118-a7ca-48bf-a024-fb9c79117f67 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:46:28:bc:dc:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:46:28:bc:dc:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:7c:9a:08:45:d5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 20:21:19.437539 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.437538 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 20:21:19.437687 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.437663 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 20:21:19.440615 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.440586 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 20:21:19.440758 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.440618 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-6.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 20:21:19.441389 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.441368 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 20:21:19.441389 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.441390 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 20:21:19.441460 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.441398 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 20:21:19.442837 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.442826 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 20:21:19.444098 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.444088 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 20:21:19.447218 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.447205 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 10 20:21:19.447333 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.447323 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 20:21:19.447377 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.447354 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 10 20:21:19.447377 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.447364 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 20:21:19.447377 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.447374 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 20:21:19.447478 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.447384 2580 kubelet.go:398] "Adding apiserver pod source" Jul 10 20:21:19.447478 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.447395 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 20:21:19.447807 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.447793 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 20:21:19.447842 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.447817 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 20:21:19.450805 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.450788 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 20:21:19.452867 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.452850 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 20:21:19.452954 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.452889 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 20:21:19.453086 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.453073 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 20:21:19.453161 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.453093 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 20:21:19.453161 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.453103 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 20:21:19.453161 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.453112 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 20:21:19.453161 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.453140 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 20:21:19.453161 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.453150 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 20:21:19.453687 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.453673 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 20:21:19.453739 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.453689 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 20:21:19.453739 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.453713 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 20:21:19.453739 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.453722 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 20:21:19.453841 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.453743 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 20:21:19.453841 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.453757 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 20:21:19.454576 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.454565 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 20:21:19.454624 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.454578 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 20:21:19.456741 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.456721 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xksw9" Jul 10 20:21:19.457751 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.457732 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-6.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 20:21:19.457751 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:19.457736 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 20:21:19.457889 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:19.457761 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-6.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 20:21:19.457939 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.457913 2580 server.go:1268] "Started kubelet" Jul 10 20:21:19.457998 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.457970 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 20:21:19.458067 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.458038 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 20:21:19.458105 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.458091 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 20:21:19.462498 ip-10-0-133-6 systemd[1]: Started Kubernetes Kubelet. Jul 10 20:21:19.463600 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.463548 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 20:21:19.464265 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.464246 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 10 20:21:19.464387 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.464367 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xksw9" Jul 10 20:21:19.464919 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:19.464889 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 20:21:19.468722 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.468704 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 20:21:19.468722 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.468718 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 20:21:19.468849 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:19.468793 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-6.ec2.internal\" not found" Jul 10 20:21:19.469452 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.469308 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 20:21:19.469452 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.469309 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 20:21:19.469452 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.469340 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 20:21:19.469452 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.469440 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 10 20:21:19.469452 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.469449 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 10 20:21:19.469678 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.469518 2580 factory.go:55] Registering systemd factory Jul 10 20:21:19.469678 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.469533 2580 factory.go:223] Registration of the systemd container factory successfully Jul 10 20:21:19.469790 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.469755 2580 factory.go:153] Registering CRI-O factory Jul 10 20:21:19.469790 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.469766 2580 factory.go:223] Registration of the crio container factory successfully Jul 10 20:21:19.469885 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.469812 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 20:21:19.469885 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.469838 2580 factory.go:103] Registering Raw factory Jul 10 20:21:19.469885 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.469852 2580 manager.go:1196] Started watching for new ooms in manager Jul 10 20:21:19.470283 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.470266 2580 manager.go:349] Starting recovery of all containers Jul 10 20:21:19.473670 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.473649 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:21:19.476560 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:19.476522 2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-6.ec2.internal\" not found" node="ip-10-0-133-6.ec2.internal" Jul 10 20:21:19.478573 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.478553 2580 manager.go:354] Recovery completed Jul 10 20:21:19.483069 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.483051 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:21:19.485076 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.484977 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:21:19.485076 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.485003 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:21:19.485076 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.485013 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:21:19.485579 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.485568 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:21:19.485632 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.485569 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 20:21:19.485668 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.485632 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 20:21:19.485668 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.485650 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 10 20:21:19.486716 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.486701 2580 policy_none.go:49] "None policy: Start" Jul 10 20:21:19.486781 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.486719 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 20:21:19.486781 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.486729 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 20:21:19.486860 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.486803 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:21:19.486860 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.486827 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:21:19.486860 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.486840 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:21:19.487596 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.487584 2580 policy_none.go:47] "Start" Jul 10 20:21:19.519943 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.519802 2580 manager.go:337] "Starting Device Plugin manager" Jul 10 20:21:19.520059 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:19.519974 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 20:21:19.520059 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.519985 2580 server.go:87] "Starting device plugin registration server" Jul 10 20:21:19.520314 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.520301 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 20:21:19.520353 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.520321 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 20:21:19.520423 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.520407 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 20:21:19.520559 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.520499 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 20:21:19.520559 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.520513 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 20:21:19.521609 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:19.521588 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 20:21:19.521671 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:19.521634 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-6.ec2.internal\" not found" Jul 10 20:21:19.620638 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.620609 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:21:19.621811 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.621749 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:21:19.621811 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.621781 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:21:19.621811 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.621795 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:21:19.621947 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.621823 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-6.ec2.internal" Jul 10 20:21:19.633282 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.633213 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-6.ec2.internal" Jul 10 20:21:19.633282 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:19.633242 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-6.ec2.internal\": node \"ip-10-0-133-6.ec2.internal\" not found" Jul 10 20:21:19.652795 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.652768 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 20:21:19.653938 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.653920 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 20:21:19.654062 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.653957 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 20:21:19.654062 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.653980 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 20:21:19.654062 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:19.654016 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 20:21:19.659060 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.659038 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:21:19.668329 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:19.668310 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-6.ec2.internal\" not found" Jul 10 20:21:19.754344 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.754296 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-6.ec2.internal"] Jul 10 20:21:19.754453 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.754395 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:21:19.755449 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.755426 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:21:19.755603 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.755465 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:21:19.755603 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.755479 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:21:19.756836 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.756821 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:21:19.756961 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.756944 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal" Jul 10 20:21:19.757014 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.756978 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:21:19.757559 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.757543 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:21:19.757622 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.757572 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:21:19.757622 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.757582 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:21:19.757682 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.757543 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:21:19.757682 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.757656 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:21:19.757682 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.757673 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:21:19.759038 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.759024 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-6.ec2.internal" Jul 10 20:21:19.759091 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.759051 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 20:21:19.759765 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.759751 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasSufficientMemory" Jul 10 20:21:19.759832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.759771 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 20:21:19.759832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.759780 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeHasSufficientPID" Jul 10 20:21:19.769170 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:19.769154 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-6.ec2.internal\" not found" Jul 10 20:21:19.772431 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.772417 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/42b555af7be47887e8a2180500609831-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal\" (UID: \"42b555af7be47887e8a2180500609831\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal" Jul 10 20:21:19.772484 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.772438 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42b555af7be47887e8a2180500609831-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal\" (UID: \"42b555af7be47887e8a2180500609831\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal" Jul 10 20:21:19.772484 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.772455 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/423ffdfdc9b0aa9c91a91910587e3e86-config\") pod \"kube-apiserver-proxy-ip-10-0-133-6.ec2.internal\" (UID: \"423ffdfdc9b0aa9c91a91910587e3e86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-6.ec2.internal" Jul 10 20:21:19.783867 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:19.783848 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-6.ec2.internal\" not found" node="ip-10-0-133-6.ec2.internal" Jul 10 20:21:19.788423 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:19.788405 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-6.ec2.internal\" not found" node="ip-10-0-133-6.ec2.internal" Jul 10 20:21:19.870172 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:19.870118 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-6.ec2.internal\" not found" Jul 10 20:21:19.873328 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.873307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/42b555af7be47887e8a2180500609831-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal\" (UID: \"42b555af7be47887e8a2180500609831\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal" Jul 10 20:21:19.873389 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.873338 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42b555af7be47887e8a2180500609831-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal\" (UID: \"42b555af7be47887e8a2180500609831\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal" Jul 10 20:21:19.873389 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.873356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/423ffdfdc9b0aa9c91a91910587e3e86-config\") pod \"kube-apiserver-proxy-ip-10-0-133-6.ec2.internal\" (UID: \"423ffdfdc9b0aa9c91a91910587e3e86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-6.ec2.internal" Jul 10 20:21:19.873456 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.873419 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/42b555af7be47887e8a2180500609831-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal\" (UID: \"42b555af7be47887e8a2180500609831\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal" Jul 10 20:21:19.873489 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.873426 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42b555af7be47887e8a2180500609831-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal\" (UID: \"42b555af7be47887e8a2180500609831\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal" Jul 10 20:21:19.873489 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:19.873470 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/423ffdfdc9b0aa9c91a91910587e3e86-config\") pod \"kube-apiserver-proxy-ip-10-0-133-6.ec2.internal\" (UID: \"423ffdfdc9b0aa9c91a91910587e3e86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-6.ec2.internal" Jul 10 20:21:19.970945 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:19.970861 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-6.ec2.internal\" not found" Jul 10 20:21:20.071416 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:20.071379 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-6.ec2.internal\" not found" Jul 10 20:21:20.085713 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:20.085687 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal" Jul 10 20:21:20.091652 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:20.091633 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-6.ec2.internal" Jul 10 20:21:20.171894 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:20.171843 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-6.ec2.internal\" not found" Jul 10 20:21:20.272445 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:20.272377 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-6.ec2.internal\" not found" Jul 10 20:21:20.295754 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:20.295729 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:21:20.373141 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:20.373093 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-6.ec2.internal\" not found" Jul 10 20:21:20.407566 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:20.407537 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 20:21:20.407971 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:20.407687 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 20:21:20.407971 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:20.407732 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 20:21:20.407971 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:20.407732 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 20:21:20.469403 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:20.469368 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 20:16:19 +0000 UTC" deadline="2028-02-19 03:02:15.954140859 +0000 UTC" Jul 10 20:21:20.469403 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:20.469397 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14118h40m55.484746655s" Jul 10 20:21:20.474039 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:20.474021 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-6.ec2.internal\" not found" Jul 10 20:21:20.512568 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:20.512539 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:21:20.569596 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:20.569522 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-6.ec2.internal" Jul 10 20:21:20.579537 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:20.579514 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 20:21:20.580485 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:20.580472 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal" Jul 10 20:21:20.590085 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:20.590065 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 20:21:20.619554 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:20.619525 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b555af7be47887e8a2180500609831.slice/crio-b4af6d1f6113be8b21d4fdea0825f1f50257e12e6cda6b7a28f91bb7af012b5b WatchSource:0}: Error finding container b4af6d1f6113be8b21d4fdea0825f1f50257e12e6cda6b7a28f91bb7af012b5b: Status 404 returned error can't find the container with id b4af6d1f6113be8b21d4fdea0825f1f50257e12e6cda6b7a28f91bb7af012b5b Jul 10 20:21:20.619776 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:20.619757 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423ffdfdc9b0aa9c91a91910587e3e86.slice/crio-75ec3143e8040e221b168156e8225e000cd5c798cf3372427bb20fb9a68cd1ab WatchSource:0}: Error finding container 75ec3143e8040e221b168156e8225e000cd5c798cf3372427bb20fb9a68cd1ab: Status 404 returned error can't find the container with id 75ec3143e8040e221b168156e8225e000cd5c798cf3372427bb20fb9a68cd1ab Jul 10 20:21:20.624149 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:20.624118 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 20:21:20.657369 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:20.657316 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-6.ec2.internal" event={"ID":"423ffdfdc9b0aa9c91a91910587e3e86","Type":"ContainerStarted","Data":"75ec3143e8040e221b168156e8225e000cd5c798cf3372427bb20fb9a68cd1ab"} Jul 10 20:21:20.658314 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:20.658293 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal" event={"ID":"42b555af7be47887e8a2180500609831","Type":"ContainerStarted","Data":"b4af6d1f6113be8b21d4fdea0825f1f50257e12e6cda6b7a28f91bb7af012b5b"} Jul 10 20:21:21.448869 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.448832 2580 apiserver.go:52] "Watching apiserver" Jul 10 20:21:21.460457 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.458185 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 20:21:21.461622 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.461593 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-cgjgd","kube-system/konnectivity-agent-nrjmp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp","openshift-cluster-node-tuning-operator/tuned-6ms2x","openshift-image-registry/node-ca-tq429","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal","openshift-multus/multus-additional-cni-plugins-cgcl5","openshift-multus/multus-hbr6v","kube-system/kube-apiserver-proxy-ip-10-0-133-6.ec2.internal","openshift-dns/node-resolver-dlpg8","openshift-multus/network-metrics-daemon-gsjgb","openshift-network-diagnostics/network-check-target-rj4l7","openshift-network-operator/iptables-alerter-rdjhx","openshift-ovn-kubernetes/ovnkube-node-n9x79"] Jul 10 20:21:21.463487 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.463465 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.465457 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.465433 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rdjhx" Jul 10 20:21:21.466109 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.466046 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 20:21:21.466219 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.466046 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 20:21:21.467147 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.466674 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.467147 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.467034 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 20:21:21.468054 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.467282 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 20:21:21.468054 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.467394 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 20:21:21.468054 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.467615 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 20:21:21.468054 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.467633 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-psrr5\"" Jul 10 20:21:21.468054 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.467920 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 20:21:21.468054 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.467939 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v6snw\"" Jul 10 20:21:21.468408 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.468187 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 20:21:21.468499 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.468452 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.468631 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.468613 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:21:21.468821 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.468806 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 20:21:21.469039 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.469023 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hzbp7\"" Jul 10 20:21:21.469340 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.469323 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 20:21:21.469635 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.469618 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 20:21:21.469862 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.469847 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 20:21:21.470102 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.469923 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tq429" Jul 10 20:21:21.470879 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.470863 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 20:21:21.470961 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.470903 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 20:21:21.471028 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.471015 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jr6h6\"" Jul 10 20:21:21.471230 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.471213 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.472414 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.472397 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-grs2f\"" Jul 10 20:21:21.472712 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.472693 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.472997 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.472981 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 20:21:21.473303 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.472700 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 20:21:21.473436 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.473418 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 20:21:21.473557 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.473356 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 20:21:21.473668 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.473648 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 20:21:21.473959 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.473906 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 20:21:21.474050 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.474036 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:21.474259 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:21.474140 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:21.474598 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.474420 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mskjc\"" Jul 10 20:21:21.474598 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.474444 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 20:21:21.475360 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.474782 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 20:21:21.475360 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.474972 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 20:21:21.475360 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.475211 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 20:21:21.475778 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.475535 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-d62gr\"" Jul 10 20:21:21.475830 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.475789 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nrjmp" Jul 10 20:21:21.476604 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.476516 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dlpg8" Jul 10 20:21:21.478226 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.478022 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 20:21:21.478226 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.478033 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 20:21:21.478366 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.478293 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mc449\"" Jul 10 20:21:21.478464 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.478444 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 20:21:21.478668 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.478615 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:21.478784 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.478770 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 20:21:21.478784 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.478780 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2dvpf\"" Jul 10 20:21:21.479172 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.479151 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:21.479255 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:21.479209 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:21.479255 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:21.479244 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:21.480608 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.480587 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-os-release\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.480692 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.480621 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.480692 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.480647 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4hp8\" (UniqueName: \"kubernetes.io/projected/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-kube-api-access-j4hp8\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.480794 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.480693 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-sys\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.480794 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.480719 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50b711c2-8a0a-424b-a81f-472c99fed309-tmp\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.480794 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.480740 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4c479fa-abe8-4123-a651-449f41f51e85-host\") pod \"node-ca-tq429\" (UID: \"e4c479fa-abe8-4123-a651-449f41f51e85\") " pod="openshift-image-registry/node-ca-tq429" Jul 10 20:21:21.480794 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.480762 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.480794 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.480788 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a15649ba-69b0-4cee-b67d-401af3ab4368-iptables-alerter-script\") pod \"iptables-alerter-rdjhx\" (UID: \"a15649ba-69b0-4cee-b67d-401af3ab4368\") " pod="openshift-network-operator/iptables-alerter-rdjhx" Jul 10 20:21:21.481060 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.480832 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5k8s\" (UniqueName: \"kubernetes.io/projected/a15649ba-69b0-4cee-b67d-401af3ab4368-kube-api-access-z5k8s\") pod \"iptables-alerter-rdjhx\" (UID: \"a15649ba-69b0-4cee-b67d-401af3ab4368\") " pod="openshift-network-operator/iptables-alerter-rdjhx" Jul 10 20:21:21.481060 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.480866 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.481060 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.480894 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-host\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.481060 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.480927 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-registration-dir\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.481060 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.480968 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-sys-fs\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.481060 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.480991 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgnp6\" (UniqueName: \"kubernetes.io/projected/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-kube-api-access-bgnp6\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.481060 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481013 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-lib-modules\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.481060 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481034 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/50b711c2-8a0a-424b-a81f-472c99fed309-etc-tuned\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.481451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481067 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-device-dir\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.481451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-etc-selinux\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.481451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481143 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-run\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.481451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481167 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4c479fa-abe8-4123-a651-449f41f51e85-serviceca\") pod \"node-ca-tq429\" (UID: \"e4c479fa-abe8-4123-a651-449f41f51e85\") " pod="openshift-image-registry/node-ca-tq429" Jul 10 20:21:21.481451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481208 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcsb8\" (UniqueName: \"kubernetes.io/projected/e4c479fa-abe8-4123-a651-449f41f51e85-kube-api-access-tcsb8\") pod \"node-ca-tq429\" (UID: \"e4c479fa-abe8-4123-a651-449f41f51e85\") " pod="openshift-image-registry/node-ca-tq429" Jul 10 20:21:21.481451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481242 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-system-cni-dir\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.481451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481262 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-modprobe-d\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.481451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481288 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-cnibin\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.481451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481323 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.481451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481360 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a15649ba-69b0-4cee-b67d-401af3ab4368-host-slash\") pod \"iptables-alerter-rdjhx\" (UID: \"a15649ba-69b0-4cee-b67d-401af3ab4368\") " pod="openshift-network-operator/iptables-alerter-rdjhx" Jul 10 20:21:21.481451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481389 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-kubernetes\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.481451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481414 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-sysctl-conf\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.481451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481436 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-var-lib-kubelet\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.482026 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481472 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-cni-binary-copy\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.482026 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481500 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-socket-dir\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.482026 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481523 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-sysctl-d\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.482026 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481544 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-sysconfig\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.482026 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481565 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-systemd\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.482026 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481588 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v56f\" (UniqueName: \"kubernetes.io/projected/50b711c2-8a0a-424b-a81f-472c99fed309-kube-api-access-4v56f\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.482026 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.481877 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 20:21:21.500234 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.500192 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jw9zv" Jul 10 20:21:21.506807 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.506450 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jw9zv" Jul 10 20:21:21.570975 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.570952 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 20:21:21.582398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582370 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-device-dir\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.582398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582404 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-os-release\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.582591 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582424 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-run-ovn-kubernetes\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.582591 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582440 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f7b5179-aa27-496e-9181-5c85edf27e29-hosts-file\") pod \"node-resolver-dlpg8\" (UID: \"8f7b5179-aa27-496e-9181-5c85edf27e29\") " pod="openshift-dns/node-resolver-dlpg8" Jul 10 20:21:21.582591 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582493 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-modprobe-d\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.582591 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582510 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-device-dir\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.582591 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582515 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-log-socket\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.582591 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582570 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq9wp\" (UniqueName: \"kubernetes.io/projected/1d2a9a56-7498-4287-92d4-d6805d7fefa4-kube-api-access-zq9wp\") pod \"network-metrics-daemon-gsjgb\" (UID: \"1d2a9a56-7498-4287-92d4-d6805d7fefa4\") " pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:21.582834 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582599 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-cnibin\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.582834 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582610 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-modprobe-d\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.582834 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582624 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-kubernetes\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.582834 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-sysctl-conf\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.582834 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582676 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-var-lib-kubelet\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.582834 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582694 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-cnibin\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.582834 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582737 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-var-lib-kubelet\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.582834 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582733 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-kubernetes\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.582834 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582760 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-run-multus-certs\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.582834 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582784 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-sysctl-conf\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.582834 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582794 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-etc-kubernetes\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.582834 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582823 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-cni-binary-copy\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.583340 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582853 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-system-cni-dir\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.583340 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582910 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-run-ovn\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.583340 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582935 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54408f7e-c518-4ea9-943f-f77237ea1102-ovnkube-config\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.583340 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582956 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-systemd\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.583340 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.582989 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-cni-bin\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.583340 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583004 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-systemd\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.583340 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583062 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs\") pod \"network-metrics-daemon-gsjgb\" (UID: \"1d2a9a56-7498-4287-92d4-d6805d7fefa4\") " pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:21.583340 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583096 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.583340 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583121 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50b711c2-8a0a-424b-a81f-472c99fed309-tmp\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.583340 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583160 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/feb78f8a-7e80-4546-a840-3d15bc2dba14-multus-daemon-config\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.583340 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583182 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-kubelet\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.583340 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583205 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hn5b\" (UniqueName: \"kubernetes.io/projected/8f7b5179-aa27-496e-9181-5c85edf27e29-kube-api-access-6hn5b\") pod \"node-resolver-dlpg8\" (UID: \"8f7b5179-aa27-496e-9181-5c85edf27e29\") " pod="openshift-dns/node-resolver-dlpg8" Jul 10 20:21:21.583340 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583241 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2957\" (UniqueName: \"kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957\") pod \"network-check-target-rj4l7\" (UID: \"bef08af3-bb5b-4bf3-97a1-0afdb5a63735\") " pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:21.583340 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583287 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.583340 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583328 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-host\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.584053 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583359 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-multus-socket-dir-parent\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.584053 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583380 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.584053 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583386 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-run-k8s-cni-cncf-io\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.584053 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583421 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret\") pod \"global-pull-secret-syncer-cgjgd\" (UID: \"54004500-c887-4445-ba31-1c7db58bbb4d\") " pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:21.584053 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583422 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 20:21:21.584053 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583435 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-host\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.584053 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583450 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-slash\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.584053 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583475 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-var-lib-openvswitch\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.584053 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583500 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f7b5179-aa27-496e-9181-5c85edf27e29-tmp-dir\") pod \"node-resolver-dlpg8\" (UID: \"8f7b5179-aa27-496e-9181-5c85edf27e29\") " pod="openshift-dns/node-resolver-dlpg8" Jul 10 20:21:21.584053 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583509 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-cni-binary-copy\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.584053 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583529 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgnp6\" (UniqueName: \"kubernetes.io/projected/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-kube-api-access-bgnp6\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.584053 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583556 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-cnibin\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.584053 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583574 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.584053 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583579 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-run-netns\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.584053 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583605 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.584053 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583633 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-etc-selinux\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.584053 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583657 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-run\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.584832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583684 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4c479fa-abe8-4123-a651-449f41f51e85-serviceca\") pod \"node-ca-tq429\" (UID: \"e4c479fa-abe8-4123-a651-449f41f51e85\") " pod="openshift-image-registry/node-ca-tq429" Jul 10 20:21:21.584832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583707 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcsb8\" (UniqueName: \"kubernetes.io/projected/e4c479fa-abe8-4123-a651-449f41f51e85-kube-api-access-tcsb8\") pod \"node-ca-tq429\" (UID: \"e4c479fa-abe8-4123-a651-449f41f51e85\") " pod="openshift-image-registry/node-ca-tq429" Jul 10 20:21:21.584832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-node-log\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.584832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583754 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-system-cni-dir\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.584832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583772 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-etc-selinux\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.584832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583777 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-run\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.584832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583783 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.584832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583859 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a15649ba-69b0-4cee-b67d-401af3ab4368-host-slash\") pod \"iptables-alerter-rdjhx\" (UID: \"a15649ba-69b0-4cee-b67d-401af3ab4368\") " pod="openshift-network-operator/iptables-alerter-rdjhx" Jul 10 20:21:21.584832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583897 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/439772ec-a894-482d-95aa-449e9db39ca7-konnectivity-ca\") pod \"konnectivity-agent-nrjmp\" (UID: \"439772ec-a894-482d-95aa-449e9db39ca7\") " pod="kube-system/konnectivity-agent-nrjmp" Jul 10 20:21:21.584832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583934 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-system-cni-dir\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.584832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583946 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a15649ba-69b0-4cee-b67d-401af3ab4368-host-slash\") pod \"iptables-alerter-rdjhx\" (UID: \"a15649ba-69b0-4cee-b67d-401af3ab4368\") " pod="openshift-network-operator/iptables-alerter-rdjhx" Jul 10 20:21:21.584832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583967 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-socket-dir\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.584832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.583997 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-sysctl-d\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.584832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584054 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-cni-netd\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.584832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584077 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-socket-dir\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.584832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584082 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54408f7e-c518-4ea9-943f-f77237ea1102-ovnkube-script-lib\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.584832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584091 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e4c479fa-abe8-4123-a651-449f41f51e85-serviceca\") pod \"node-ca-tq429\" (UID: \"e4c479fa-abe8-4123-a651-449f41f51e85\") " pod="openshift-image-registry/node-ca-tq429" Jul 10 20:21:21.585354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584101 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-sysctl-d\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.585354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584114 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-sysconfig\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.585354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584171 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v56f\" (UniqueName: \"kubernetes.io/projected/50b711c2-8a0a-424b-a81f-472c99fed309-kube-api-access-4v56f\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.585354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584175 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-etc-sysconfig\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.585354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584209 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-multus-cni-dir\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.585354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584233 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-var-lib-kubelet\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.585354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584249 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-hostroot\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.585354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584263 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-multus-conf-dir\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.585354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584283 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54004500-c887-4445-ba31-1c7db58bbb4d-dbus\") pod \"global-pull-secret-syncer-cgjgd\" (UID: \"54004500-c887-4445-ba31-1c7db58bbb4d\") " pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:21.585354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584285 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.585354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584308 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-etc-openvswitch\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.585354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584336 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-os-release\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.585354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584393 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4hp8\" (UniqueName: \"kubernetes.io/projected/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-kube-api-access-j4hp8\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.585354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584425 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-sys\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.585354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584398 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-os-release\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.585354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584448 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4c479fa-abe8-4123-a651-449f41f51e85-host\") pod \"node-ca-tq429\" (UID: \"e4c479fa-abe8-4123-a651-449f41f51e85\") " pod="openshift-image-registry/node-ca-tq429" Jul 10 20:21:21.585354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584478 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-run-openvswitch\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.585910 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584502 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54408f7e-c518-4ea9-943f-f77237ea1102-env-overrides\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.585910 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584505 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-sys\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.585910 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584553 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e4c479fa-abe8-4123-a651-449f41f51e85-host\") pod \"node-ca-tq429\" (UID: \"e4c479fa-abe8-4123-a651-449f41f51e85\") " pod="openshift-image-registry/node-ca-tq429" Jul 10 20:21:21.585910 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbt2f\" (UniqueName: \"kubernetes.io/projected/54408f7e-c518-4ea9-943f-f77237ea1102-kube-api-access-xbt2f\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.585910 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584587 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h4z6\" (UniqueName: \"kubernetes.io/projected/feb78f8a-7e80-4546-a840-3d15bc2dba14-kube-api-access-6h4z6\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.585910 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584614 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54004500-c887-4445-ba31-1c7db58bbb4d-kubelet-config\") pod \"global-pull-secret-syncer-cgjgd\" (UID: \"54004500-c887-4445-ba31-1c7db58bbb4d\") " pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:21.585910 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584632 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.585910 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584661 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a15649ba-69b0-4cee-b67d-401af3ab4368-iptables-alerter-script\") pod \"iptables-alerter-rdjhx\" (UID: \"a15649ba-69b0-4cee-b67d-401af3ab4368\") " pod="openshift-network-operator/iptables-alerter-rdjhx" Jul 10 20:21:21.585910 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584758 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5k8s\" (UniqueName: \"kubernetes.io/projected/a15649ba-69b0-4cee-b67d-401af3ab4368-kube-api-access-z5k8s\") pod \"iptables-alerter-rdjhx\" (UID: \"a15649ba-69b0-4cee-b67d-401af3ab4368\") " pod="openshift-network-operator/iptables-alerter-rdjhx" Jul 10 20:21:21.585910 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584782 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.585910 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584786 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/feb78f8a-7e80-4546-a840-3d15bc2dba14-cni-binary-copy\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.585910 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584839 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-var-lib-cni-bin\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.585910 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584863 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54408f7e-c518-4ea9-943f-f77237ea1102-ovn-node-metrics-cert\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.585910 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584901 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-registration-dir\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.585910 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.584934 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-sys-fs\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.585910 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.585019 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-registration-dir\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.585910 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.585022 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a15649ba-69b0-4cee-b67d-401af3ab4368-iptables-alerter-script\") pod \"iptables-alerter-rdjhx\" (UID: \"a15649ba-69b0-4cee-b67d-401af3ab4368\") " pod="openshift-network-operator/iptables-alerter-rdjhx" Jul 10 20:21:21.586612 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.585045 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-lib-modules\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.586612 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.585063 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-sys-fs\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.586612 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.585109 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/50b711c2-8a0a-424b-a81f-472c99fed309-lib-modules\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.586612 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.585157 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/50b711c2-8a0a-424b-a81f-472c99fed309-etc-tuned\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.586612 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.585185 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-run-netns\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.586612 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.585213 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-systemd-units\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.586612 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.585260 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-run-systemd\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.586612 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.585298 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/439772ec-a894-482d-95aa-449e9db39ca7-agent-certs\") pod \"konnectivity-agent-nrjmp\" (UID: \"439772ec-a894-482d-95aa-449e9db39ca7\") " pod="kube-system/konnectivity-agent-nrjmp" Jul 10 20:21:21.586612 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.585341 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-var-lib-cni-multus\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.587525 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.587502 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/50b711c2-8a0a-424b-a81f-472c99fed309-etc-tuned\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.588091 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.588070 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/50b711c2-8a0a-424b-a81f-472c99fed309-tmp\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.592514 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.592490 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgnp6\" (UniqueName: \"kubernetes.io/projected/91ef7c3a-87b9-4601-ae24-0dc1fbc00153-kube-api-access-bgnp6\") pod \"aws-ebs-csi-driver-node-rtllp\" (UID: \"91ef7c3a-87b9-4601-ae24-0dc1fbc00153\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.592707 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.592689 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v56f\" (UniqueName: \"kubernetes.io/projected/50b711c2-8a0a-424b-a81f-472c99fed309-kube-api-access-4v56f\") pod \"tuned-6ms2x\" (UID: \"50b711c2-8a0a-424b-a81f-472c99fed309\") " pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.592934 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.592896 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcsb8\" (UniqueName: \"kubernetes.io/projected/e4c479fa-abe8-4123-a651-449f41f51e85-kube-api-access-tcsb8\") pod \"node-ca-tq429\" (UID: \"e4c479fa-abe8-4123-a651-449f41f51e85\") " pod="openshift-image-registry/node-ca-tq429" Jul 10 20:21:21.593033 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.592966 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4hp8\" (UniqueName: \"kubernetes.io/projected/52d41eb6-7de4-4fd7-8ee6-fd0397982de4-kube-api-access-j4hp8\") pod \"multus-additional-cni-plugins-cgcl5\" (UID: \"52d41eb6-7de4-4fd7-8ee6-fd0397982de4\") " pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.594510 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.594476 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5k8s\" (UniqueName: \"kubernetes.io/projected/a15649ba-69b0-4cee-b67d-401af3ab4368-kube-api-access-z5k8s\") pod \"iptables-alerter-rdjhx\" (UID: \"a15649ba-69b0-4cee-b67d-401af3ab4368\") " pod="openshift-network-operator/iptables-alerter-rdjhx" Jul 10 20:21:21.686685 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686645 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54004500-c887-4445-ba31-1c7db58bbb4d-kubelet-config\") pod \"global-pull-secret-syncer-cgjgd\" (UID: \"54004500-c887-4445-ba31-1c7db58bbb4d\") " pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:21.686886 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686694 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/feb78f8a-7e80-4546-a840-3d15bc2dba14-cni-binary-copy\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.686886 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686721 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-var-lib-cni-bin\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.686886 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686747 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54408f7e-c518-4ea9-943f-f77237ea1102-ovn-node-metrics-cert\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.686886 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686771 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-run-netns\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.686886 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686785 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-systemd-units\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.686886 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686798 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-run-systemd\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.686886 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686812 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/439772ec-a894-482d-95aa-449e9db39ca7-agent-certs\") pod \"konnectivity-agent-nrjmp\" (UID: \"439772ec-a894-482d-95aa-449e9db39ca7\") " pod="kube-system/konnectivity-agent-nrjmp" Jul 10 20:21:21.686886 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686806 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-var-lib-cni-bin\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.686886 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-var-lib-cni-multus\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.686886 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686848 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54004500-c887-4445-ba31-1c7db58bbb4d-kubelet-config\") pod \"global-pull-secret-syncer-cgjgd\" (UID: \"54004500-c887-4445-ba31-1c7db58bbb4d\") " pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:21.686886 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686864 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-os-release\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.686886 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686862 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-run-netns\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.686886 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686883 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-run-systemd\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-run-ovn-kubernetes\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686930 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-systemd-units\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686935 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-var-lib-cni-multus\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686934 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f7b5179-aa27-496e-9181-5c85edf27e29-hosts-file\") pod \"node-resolver-dlpg8\" (UID: \"8f7b5179-aa27-496e-9181-5c85edf27e29\") " pod="openshift-dns/node-resolver-dlpg8" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686976 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-log-socket\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.686982 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-os-release\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687001 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq9wp\" (UniqueName: \"kubernetes.io/projected/1d2a9a56-7498-4287-92d4-d6805d7fefa4-kube-api-access-zq9wp\") pod \"network-metrics-daemon-gsjgb\" (UID: \"1d2a9a56-7498-4287-92d4-d6805d7fefa4\") " pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687008 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-run-ovn-kubernetes\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687039 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8f7b5179-aa27-496e-9181-5c85edf27e29-hosts-file\") pod \"node-resolver-dlpg8\" (UID: \"8f7b5179-aa27-496e-9181-5c85edf27e29\") " pod="openshift-dns/node-resolver-dlpg8" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687045 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-log-socket\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687198 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-run-multus-certs\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-etc-kubernetes\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687234 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-system-cni-dir\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687250 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-run-ovn\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687265 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54408f7e-c518-4ea9-943f-f77237ea1102-ovnkube-config\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-cni-bin\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687335 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/feb78f8a-7e80-4546-a840-3d15bc2dba14-cni-binary-copy\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.687590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687353 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-etc-kubernetes\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.688398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687298 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs\") pod \"network-metrics-daemon-gsjgb\" (UID: \"1d2a9a56-7498-4287-92d4-d6805d7fefa4\") " pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:21.688398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687400 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-system-cni-dir\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.688398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687404 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-cni-bin\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.688398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687401 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/feb78f8a-7e80-4546-a840-3d15bc2dba14-multus-daemon-config\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.688398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687353 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-run-ovn\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.688398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687358 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-run-multus-certs\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.688398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687444 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-kubelet\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.688398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687473 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hn5b\" (UniqueName: \"kubernetes.io/projected/8f7b5179-aa27-496e-9181-5c85edf27e29-kube-api-access-6hn5b\") pod \"node-resolver-dlpg8\" (UID: \"8f7b5179-aa27-496e-9181-5c85edf27e29\") " pod="openshift-dns/node-resolver-dlpg8" Jul 10 20:21:21.688398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687502 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2957\" (UniqueName: \"kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957\") pod \"network-check-target-rj4l7\" (UID: \"bef08af3-bb5b-4bf3-97a1-0afdb5a63735\") " pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:21.688398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687532 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-multus-socket-dir-parent\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.688398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687541 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-kubelet\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.688398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687555 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-run-k8s-cni-cncf-io\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.688398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687579 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret\") pod \"global-pull-secret-syncer-cgjgd\" (UID: \"54004500-c887-4445-ba31-1c7db58bbb4d\") " pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:21.688398 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:21.687675 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:21.688398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687708 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-slash\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.688398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687770 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-slash\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.688398 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:21.687778 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret podName:54004500-c887-4445-ba31-1c7db58bbb4d nodeName:}" failed. No retries permitted until 2026-07-10 20:21:22.18773622 +0000 UTC m=+3.647941041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret") pod "global-pull-secret-syncer-cgjgd" (UID: "54004500-c887-4445-ba31-1c7db58bbb4d") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687799 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-var-lib-openvswitch\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687821 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-run-k8s-cni-cncf-io\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687826 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f7b5179-aa27-496e-9181-5c85edf27e29-tmp-dir\") pod \"node-resolver-dlpg8\" (UID: \"8f7b5179-aa27-496e-9181-5c85edf27e29\") " pod="openshift-dns/node-resolver-dlpg8" Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-cnibin\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687864 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54408f7e-c518-4ea9-943f-f77237ea1102-ovnkube-config\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687875 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-run-netns\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687879 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-multus-socket-dir-parent\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687892 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/feb78f8a-7e80-4546-a840-3d15bc2dba14-multus-daemon-config\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687916 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-run-netns\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687934 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687965 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-var-lib-openvswitch\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687969 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-node-log\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687983 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688004 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-node-log\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.687937 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-cnibin\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688004 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/439772ec-a894-482d-95aa-449e9db39ca7-konnectivity-ca\") pod \"konnectivity-agent-nrjmp\" (UID: \"439772ec-a894-482d-95aa-449e9db39ca7\") " pod="kube-system/konnectivity-agent-nrjmp" Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688048 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-cni-netd\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.689121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688075 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54408f7e-c518-4ea9-943f-f77237ea1102-ovnkube-script-lib\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:21.688071 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688104 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-multus-cni-dir\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688114 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f7b5179-aa27-496e-9181-5c85edf27e29-tmp-dir\") pod \"node-resolver-dlpg8\" (UID: \"8f7b5179-aa27-496e-9181-5c85edf27e29\") " pod="openshift-dns/node-resolver-dlpg8" Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688148 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-var-lib-kubelet\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:21.688162 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs podName:1d2a9a56-7498-4287-92d4-d6805d7fefa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:22.188143741 +0000 UTC m=+3.648348560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs") pod "network-metrics-daemon-gsjgb" (UID: "1d2a9a56-7498-4287-92d4-d6805d7fefa4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688183 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-host-var-lib-kubelet\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688187 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-host-cni-netd\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688211 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-hostroot\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688265 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-multus-conf-dir\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688290 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54004500-c887-4445-ba31-1c7db58bbb4d-dbus\") pod \"global-pull-secret-syncer-cgjgd\" (UID: \"54004500-c887-4445-ba31-1c7db58bbb4d\") " pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688323 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-multus-cni-dir\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688346 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-etc-openvswitch\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688359 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-hostroot\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688366 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/feb78f8a-7e80-4546-a840-3d15bc2dba14-multus-conf-dir\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688378 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-run-openvswitch\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688394 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54004500-c887-4445-ba31-1c7db58bbb4d-dbus\") pod \"global-pull-secret-syncer-cgjgd\" (UID: \"54004500-c887-4445-ba31-1c7db58bbb4d\") " pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688410 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-run-openvswitch\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.689761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688407 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54408f7e-c518-4ea9-943f-f77237ea1102-env-overrides\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.690397 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688406 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54408f7e-c518-4ea9-943f-f77237ea1102-etc-openvswitch\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.690397 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688448 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbt2f\" (UniqueName: \"kubernetes.io/projected/54408f7e-c518-4ea9-943f-f77237ea1102-kube-api-access-xbt2f\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.690397 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688472 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h4z6\" (UniqueName: \"kubernetes.io/projected/feb78f8a-7e80-4546-a840-3d15bc2dba14-kube-api-access-6h4z6\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.690397 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688532 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/439772ec-a894-482d-95aa-449e9db39ca7-konnectivity-ca\") pod \"konnectivity-agent-nrjmp\" (UID: \"439772ec-a894-482d-95aa-449e9db39ca7\") " pod="kube-system/konnectivity-agent-nrjmp" Jul 10 20:21:21.690397 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688662 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54408f7e-c518-4ea9-943f-f77237ea1102-ovnkube-script-lib\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.690397 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.688798 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54408f7e-c518-4ea9-943f-f77237ea1102-env-overrides\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.690397 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.689637 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54408f7e-c518-4ea9-943f-f77237ea1102-ovn-node-metrics-cert\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.690660 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.690644 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/439772ec-a894-482d-95aa-449e9db39ca7-agent-certs\") pod \"konnectivity-agent-nrjmp\" (UID: \"439772ec-a894-482d-95aa-449e9db39ca7\") " pod="kube-system/konnectivity-agent-nrjmp" Jul 10 20:21:21.693066 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:21.693019 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:21:21.693066 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:21.693065 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:21:21.693239 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:21.693087 2580 projected.go:196] Error preparing data for projected volume kube-api-access-r2957 for pod openshift-network-diagnostics/network-check-target-rj4l7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:21.693239 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:21.693174 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957 podName:bef08af3-bb5b-4bf3-97a1-0afdb5a63735 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:22.193157041 +0000 UTC m=+3.653361856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r2957" (UniqueName: "kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957") pod "network-check-target-rj4l7" (UID: "bef08af3-bb5b-4bf3-97a1-0afdb5a63735") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:21.695443 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.695418 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hn5b\" (UniqueName: \"kubernetes.io/projected/8f7b5179-aa27-496e-9181-5c85edf27e29-kube-api-access-6hn5b\") pod \"node-resolver-dlpg8\" (UID: \"8f7b5179-aa27-496e-9181-5c85edf27e29\") " pod="openshift-dns/node-resolver-dlpg8" Jul 10 20:21:21.695720 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.695683 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq9wp\" (UniqueName: \"kubernetes.io/projected/1d2a9a56-7498-4287-92d4-d6805d7fefa4-kube-api-access-zq9wp\") pod \"network-metrics-daemon-gsjgb\" (UID: \"1d2a9a56-7498-4287-92d4-d6805d7fefa4\") " pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:21.697250 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.697201 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h4z6\" (UniqueName: \"kubernetes.io/projected/feb78f8a-7e80-4546-a840-3d15bc2dba14-kube-api-access-6h4z6\") pod \"multus-hbr6v\" (UID: \"feb78f8a-7e80-4546-a840-3d15bc2dba14\") " pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.697333 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.697272 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbt2f\" (UniqueName: \"kubernetes.io/projected/54408f7e-c518-4ea9-943f-f77237ea1102-kube-api-access-xbt2f\") pod \"ovnkube-node-n9x79\" (UID: \"54408f7e-c518-4ea9-943f-f77237ea1102\") " pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.781035 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.780946 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cgcl5" Jul 10 20:21:21.790290 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.790267 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rdjhx" Jul 10 20:21:21.800161 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.800139 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" Jul 10 20:21:21.814318 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.814276 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" Jul 10 20:21:21.823414 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.823391 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tq429" Jul 10 20:21:21.831303 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.831271 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:21.839332 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.839306 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hbr6v" Jul 10 20:21:21.846138 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.846105 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nrjmp" Jul 10 20:21:21.852638 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.852612 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dlpg8" Jul 10 20:21:21.999860 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:21.999827 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:21:22.192848 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.192815 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs\") pod \"network-metrics-daemon-gsjgb\" (UID: \"1d2a9a56-7498-4287-92d4-d6805d7fefa4\") " pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:22.193055 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.192869 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret\") pod \"global-pull-secret-syncer-cgjgd\" (UID: \"54004500-c887-4445-ba31-1c7db58bbb4d\") " pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:22.193055 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:22.192982 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:22.193055 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:22.192988 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:22.193202 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:22.193066 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret podName:54004500-c887-4445-ba31-1c7db58bbb4d nodeName:}" failed. No retries permitted until 2026-07-10 20:21:23.193042638 +0000 UTC m=+4.653247446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret") pod "global-pull-secret-syncer-cgjgd" (UID: "54004500-c887-4445-ba31-1c7db58bbb4d") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:22.193202 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:22.193083 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs podName:1d2a9a56-7498-4287-92d4-d6805d7fefa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:23.193074758 +0000 UTC m=+4.653279562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs") pod "network-metrics-daemon-gsjgb" (UID: "1d2a9a56-7498-4287-92d4-d6805d7fefa4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:22.293916 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.293874 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2957\" (UniqueName: \"kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957\") pod \"network-check-target-rj4l7\" (UID: \"bef08af3-bb5b-4bf3-97a1-0afdb5a63735\") " pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:22.294093 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:22.294067 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:21:22.294158 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:22.294097 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:21:22.294158 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:22.294112 2580 projected.go:196] Error preparing data for projected volume kube-api-access-r2957 for pod openshift-network-diagnostics/network-check-target-rj4l7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:22.294217 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:22.294190 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957 podName:bef08af3-bb5b-4bf3-97a1-0afdb5a63735 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:23.294175385 +0000 UTC m=+4.754380189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2957" (UniqueName: "kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957") pod "network-check-target-rj4l7" (UID: "bef08af3-bb5b-4bf3-97a1-0afdb5a63735") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:22.508322 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.508235 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 20:16:21 +0000 UTC" deadline="2028-01-26 08:33:11.11630053 +0000 UTC" Jul 10 20:21:22.508322 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.508269 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13548h11m48.608036269s" Jul 10 20:21:22.564108 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:22.564054 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54408f7e_c518_4ea9_943f_f77237ea1102.slice/crio-d106803357b24b3b43d1079ea5d3c32073cc94d91d2256fa58caca8e49634434 WatchSource:0}: Error finding container d106803357b24b3b43d1079ea5d3c32073cc94d91d2256fa58caca8e49634434: Status 404 returned error can't find the container with id d106803357b24b3b43d1079ea5d3c32073cc94d91d2256fa58caca8e49634434 Jul 10 20:21:22.567524 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:22.567450 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52d41eb6_7de4_4fd7_8ee6_fd0397982de4.slice/crio-f3efe9114a95e75f3770da44c895d8edd7c2234c0a412d4a460ed864d69c79d2 WatchSource:0}: Error finding container f3efe9114a95e75f3770da44c895d8edd7c2234c0a412d4a460ed864d69c79d2: Status 404 returned error can't find the container with id f3efe9114a95e75f3770da44c895d8edd7c2234c0a412d4a460ed864d69c79d2 Jul 10 20:21:22.570671 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:22.570631 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91ef7c3a_87b9_4601_ae24_0dc1fbc00153.slice/crio-c2f64b71faba120fefc85a86bd3449fdad1d1705e837af980d4194ceb039fd73 WatchSource:0}: Error finding container c2f64b71faba120fefc85a86bd3449fdad1d1705e837af980d4194ceb039fd73: Status 404 returned error can't find the container with id c2f64b71faba120fefc85a86bd3449fdad1d1705e837af980d4194ceb039fd73 Jul 10 20:21:22.571886 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:22.571772 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f7b5179_aa27_496e_9181_5c85edf27e29.slice/crio-e16815ebe55faa0ebb2bba4e4d60adfee34052d78470c4cac92819c912bc44e2 WatchSource:0}: Error finding container e16815ebe55faa0ebb2bba4e4d60adfee34052d78470c4cac92819c912bc44e2: Status 404 returned error can't find the container with id e16815ebe55faa0ebb2bba4e4d60adfee34052d78470c4cac92819c912bc44e2 Jul 10 20:21:22.576692 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:22.576662 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod439772ec_a894_482d_95aa_449e9db39ca7.slice/crio-94b0b84a50e35e4156510f4c2cf9062ebcc54e988f7877ca8e561b94d7900bc3 WatchSource:0}: Error finding container 94b0b84a50e35e4156510f4c2cf9062ebcc54e988f7877ca8e561b94d7900bc3: Status 404 returned error can't find the container with id 94b0b84a50e35e4156510f4c2cf9062ebcc54e988f7877ca8e561b94d7900bc3 Jul 10 20:21:22.579430 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:22.579407 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50b711c2_8a0a_424b_a81f_472c99fed309.slice/crio-2c30f7b51808b804c3455b4ce2da4f72c8347b6f526f37ab561698510d672074 WatchSource:0}: Error finding container 2c30f7b51808b804c3455b4ce2da4f72c8347b6f526f37ab561698510d672074: Status 404 returned error can't find the container with id 2c30f7b51808b804c3455b4ce2da4f72c8347b6f526f37ab561698510d672074 Jul 10 20:21:22.654540 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.654514 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:22.654635 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:22.654617 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:22.654673 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.654652 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:22.654713 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:22.654700 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:22.664616 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.664590 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgcl5" event={"ID":"52d41eb6-7de4-4fd7-8ee6-fd0397982de4","Type":"ContainerStarted","Data":"f3efe9114a95e75f3770da44c895d8edd7c2234c0a412d4a460ed864d69c79d2"} Jul 10 20:21:22.669686 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.669632 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-6.ec2.internal" event={"ID":"423ffdfdc9b0aa9c91a91910587e3e86","Type":"ContainerStarted","Data":"c1b3b299fc8d0b8515a992e5c2d38db87f0870909bc8edaff5e945d83a9ae398"} Jul 10 20:21:22.673422 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.673389 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" event={"ID":"50b711c2-8a0a-424b-a81f-472c99fed309","Type":"ContainerStarted","Data":"2c30f7b51808b804c3455b4ce2da4f72c8347b6f526f37ab561698510d672074"} Jul 10 20:21:22.675259 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.675239 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nrjmp" event={"ID":"439772ec-a894-482d-95aa-449e9db39ca7","Type":"ContainerStarted","Data":"94b0b84a50e35e4156510f4c2cf9062ebcc54e988f7877ca8e561b94d7900bc3"} Jul 10 20:21:22.677307 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.677278 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hbr6v" event={"ID":"feb78f8a-7e80-4546-a840-3d15bc2dba14","Type":"ContainerStarted","Data":"1ff4272f9365bd4672e5797948c8e53b6076761de8fc5af4a855e911691fe550"} Jul 10 20:21:22.678281 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.678262 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" event={"ID":"91ef7c3a-87b9-4601-ae24-0dc1fbc00153","Type":"ContainerStarted","Data":"c2f64b71faba120fefc85a86bd3449fdad1d1705e837af980d4194ceb039fd73"} Jul 10 20:21:22.680931 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.680902 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dlpg8" event={"ID":"8f7b5179-aa27-496e-9181-5c85edf27e29","Type":"ContainerStarted","Data":"e16815ebe55faa0ebb2bba4e4d60adfee34052d78470c4cac92819c912bc44e2"} Jul 10 20:21:22.681989 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.681968 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" event={"ID":"54408f7e-c518-4ea9-943f-f77237ea1102","Type":"ContainerStarted","Data":"d106803357b24b3b43d1079ea5d3c32073cc94d91d2256fa58caca8e49634434"} Jul 10 20:21:22.682582 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.682545 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-6.ec2.internal" podStartSLOduration=2.682533529 podStartE2EDuration="2.682533529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:22.682084284 +0000 UTC m=+4.142289109" watchObservedRunningTime="2026-07-10 20:21:22.682533529 +0000 UTC m=+4.142738355" Jul 10 20:21:22.684908 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.684886 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tq429" event={"ID":"e4c479fa-abe8-4123-a651-449f41f51e85","Type":"ContainerStarted","Data":"9456dc67ff4ee65cc1365b6cf4dd1d67249ac22c853a6cfa0357dbb097caab4b"} Jul 10 20:21:22.689721 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.689701 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rdjhx" event={"ID":"a15649ba-69b0-4cee-b67d-401af3ab4368","Type":"ContainerStarted","Data":"268801fa0bd71de6c12f0335a9b3dbc3857fee380be95cb3145ba95620124af4"} Jul 10 20:21:22.861584 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:22.861550 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 20:21:23.201880 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:23.201819 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs\") pod \"network-metrics-daemon-gsjgb\" (UID: \"1d2a9a56-7498-4287-92d4-d6805d7fefa4\") " pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:23.202075 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:23.201890 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret\") pod \"global-pull-secret-syncer-cgjgd\" (UID: \"54004500-c887-4445-ba31-1c7db58bbb4d\") " pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:23.202075 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:23.202070 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:23.202236 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:23.202153 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret podName:54004500-c887-4445-ba31-1c7db58bbb4d nodeName:}" failed. No retries permitted until 2026-07-10 20:21:25.202115063 +0000 UTC m=+6.662319872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret") pod "global-pull-secret-syncer-cgjgd" (UID: "54004500-c887-4445-ba31-1c7db58bbb4d") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:23.202576 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:23.202553 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:23.202677 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:23.202615 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs podName:1d2a9a56-7498-4287-92d4-d6805d7fefa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:25.202597975 +0000 UTC m=+6.662802785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs") pod "network-metrics-daemon-gsjgb" (UID: "1d2a9a56-7498-4287-92d4-d6805d7fefa4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:23.303274 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:23.303238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2957\" (UniqueName: \"kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957\") pod \"network-check-target-rj4l7\" (UID: \"bef08af3-bb5b-4bf3-97a1-0afdb5a63735\") " pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:23.303451 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:23.303430 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:21:23.303451 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:23.303450 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:21:23.303573 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:23.303463 2580 projected.go:196] Error preparing data for projected volume kube-api-access-r2957 for pod openshift-network-diagnostics/network-check-target-rj4l7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:23.303573 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:23.303524 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957 podName:bef08af3-bb5b-4bf3-97a1-0afdb5a63735 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:25.303504132 +0000 UTC m=+6.763708939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2957" (UniqueName: "kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957") pod "network-check-target-rj4l7" (UID: "bef08af3-bb5b-4bf3-97a1-0afdb5a63735") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:23.508907 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:23.508779 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 20:16:21 +0000 UTC" deadline="2027-12-22 17:11:18.165338506 +0000 UTC" Jul 10 20:21:23.508907 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:23.508840 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12716h49m54.656502374s" Jul 10 20:21:23.656383 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:23.655840 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:23.656383 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:23.656004 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:23.703842 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:23.703208 2580 generic.go:356] "Generic (PLEG): container finished" podID="42b555af7be47887e8a2180500609831" containerID="d82cb526e685a8102596604cfcb9e18314ba094bfc0c629f060e699aee42d5e4" exitCode=0 Jul 10 20:21:23.703842 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:23.703772 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal" event={"ID":"42b555af7be47887e8a2180500609831","Type":"ContainerDied","Data":"d82cb526e685a8102596604cfcb9e18314ba094bfc0c629f060e699aee42d5e4"} Jul 10 20:21:24.654703 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:24.654670 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:24.655171 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:24.654804 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:24.655171 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:24.654848 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:24.655171 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:24.654974 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:24.715270 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:24.715215 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal" event={"ID":"42b555af7be47887e8a2180500609831","Type":"ContainerStarted","Data":"d7e0a9344d4fb239b6ce081852ea0b7742ca8a473b5af2e6219f9d9bf1528ed2"} Jul 10 20:21:25.222291 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:25.221458 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs\") pod \"network-metrics-daemon-gsjgb\" (UID: \"1d2a9a56-7498-4287-92d4-d6805d7fefa4\") " pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:25.222291 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:25.221538 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret\") pod \"global-pull-secret-syncer-cgjgd\" (UID: \"54004500-c887-4445-ba31-1c7db58bbb4d\") " pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:25.222291 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:25.221693 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:25.222291 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:25.221758 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret podName:54004500-c887-4445-ba31-1c7db58bbb4d nodeName:}" failed. No retries permitted until 2026-07-10 20:21:29.221740196 +0000 UTC m=+10.681945003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret") pod "global-pull-secret-syncer-cgjgd" (UID: "54004500-c887-4445-ba31-1c7db58bbb4d") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:25.222291 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:25.222200 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:25.222291 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:25.222257 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs podName:1d2a9a56-7498-4287-92d4-d6805d7fefa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:29.222239247 +0000 UTC m=+10.682444072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs") pod "network-metrics-daemon-gsjgb" (UID: "1d2a9a56-7498-4287-92d4-d6805d7fefa4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:25.323212 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:25.322590 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2957\" (UniqueName: \"kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957\") pod \"network-check-target-rj4l7\" (UID: \"bef08af3-bb5b-4bf3-97a1-0afdb5a63735\") " pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:25.323212 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:25.322763 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:21:25.323212 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:25.322783 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:21:25.323212 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:25.322796 2580 projected.go:196] Error preparing data for projected volume kube-api-access-r2957 for pod openshift-network-diagnostics/network-check-target-rj4l7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:25.323212 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:25.322855 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957 podName:bef08af3-bb5b-4bf3-97a1-0afdb5a63735 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:29.322836453 +0000 UTC m=+10.783041261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2957" (UniqueName: "kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957") pod "network-check-target-rj4l7" (UID: "bef08af3-bb5b-4bf3-97a1-0afdb5a63735") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:25.654571 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:25.654535 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:25.654765 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:25.654692 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:26.655164 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:26.655116 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:26.655621 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:26.655168 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:26.655621 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:26.655271 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:26.655621 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:26.655388 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:27.655264 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:27.655232 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:27.655684 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:27.655376 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:28.654490 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:28.654279 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:28.654490 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:28.654393 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:28.654490 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:28.654416 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:28.654770 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:28.654517 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:29.259942 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:29.259800 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs\") pod \"network-metrics-daemon-gsjgb\" (UID: \"1d2a9a56-7498-4287-92d4-d6805d7fefa4\") " pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:29.259942 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:29.259873 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret\") pod \"global-pull-secret-syncer-cgjgd\" (UID: \"54004500-c887-4445-ba31-1c7db58bbb4d\") " pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:29.260491 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:29.259983 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:29.260491 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:29.260067 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret podName:54004500-c887-4445-ba31-1c7db58bbb4d nodeName:}" failed. No retries permitted until 2026-07-10 20:21:37.260042968 +0000 UTC m=+18.720247777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret") pod "global-pull-secret-syncer-cgjgd" (UID: "54004500-c887-4445-ba31-1c7db58bbb4d") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:29.260491 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:29.259983 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:29.260491 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:29.260164 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs podName:1d2a9a56-7498-4287-92d4-d6805d7fefa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:37.260142988 +0000 UTC m=+18.720347812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs") pod "network-metrics-daemon-gsjgb" (UID: "1d2a9a56-7498-4287-92d4-d6805d7fefa4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:29.360865 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:29.360824 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2957\" (UniqueName: \"kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957\") pod \"network-check-target-rj4l7\" (UID: \"bef08af3-bb5b-4bf3-97a1-0afdb5a63735\") " pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:29.361047 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:29.361015 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:21:29.361047 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:29.361034 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:21:29.361047 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:29.361048 2580 projected.go:196] Error preparing data for projected volume kube-api-access-r2957 for pod openshift-network-diagnostics/network-check-target-rj4l7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:29.361274 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:29.361109 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957 podName:bef08af3-bb5b-4bf3-97a1-0afdb5a63735 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:37.361089741 +0000 UTC m=+18.821294550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2957" (UniqueName: "kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957") pod "network-check-target-rj4l7" (UID: "bef08af3-bb5b-4bf3-97a1-0afdb5a63735") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:29.656162 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:29.656109 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:29.656328 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:29.656265 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:30.654501 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:30.654406 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:30.654956 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:30.654552 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:30.654956 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:30.654623 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:30.654956 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:30.654694 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:31.654320 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:31.654281 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:31.654509 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:31.654436 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:32.654838 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:32.654802 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:32.655306 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:32.654802 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:32.655306 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:32.654937 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:32.655306 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:32.655042 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:33.655148 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:33.655105 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:33.655701 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:33.655275 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:34.654399 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:34.654360 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:34.654591 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:34.654477 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:34.654591 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:34.654535 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:34.654704 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:34.654644 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:35.654596 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:35.654558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:35.655015 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:35.654703 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:36.655125 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:36.655081 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:36.655705 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:36.655081 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:36.655705 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:36.655228 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:36.655705 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:36.655327 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:37.322654 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:37.322619 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs\") pod \"network-metrics-daemon-gsjgb\" (UID: \"1d2a9a56-7498-4287-92d4-d6805d7fefa4\") " pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:37.322845 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:37.322668 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret\") pod \"global-pull-secret-syncer-cgjgd\" (UID: \"54004500-c887-4445-ba31-1c7db58bbb4d\") " pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:37.322845 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:37.322784 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:37.322845 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:37.322844 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret podName:54004500-c887-4445-ba31-1c7db58bbb4d nodeName:}" failed. No retries permitted until 2026-07-10 20:21:53.322825167 +0000 UTC m=+34.783029988 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret") pod "global-pull-secret-syncer-cgjgd" (UID: "54004500-c887-4445-ba31-1c7db58bbb4d") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:37.323010 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:37.322784 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:37.323010 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:37.322911 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs podName:1d2a9a56-7498-4287-92d4-d6805d7fefa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:53.322897654 +0000 UTC m=+34.783102467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs") pod "network-metrics-daemon-gsjgb" (UID: "1d2a9a56-7498-4287-92d4-d6805d7fefa4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:37.423751 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:37.423714 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2957\" (UniqueName: \"kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957\") pod \"network-check-target-rj4l7\" (UID: \"bef08af3-bb5b-4bf3-97a1-0afdb5a63735\") " pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:37.423929 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:37.423906 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:21:37.424011 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:37.423936 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:21:37.424011 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:37.423950 2580 projected.go:196] Error preparing data for projected volume kube-api-access-r2957 for pod openshift-network-diagnostics/network-check-target-rj4l7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:37.424111 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:37.424016 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957 podName:bef08af3-bb5b-4bf3-97a1-0afdb5a63735 nodeName:}" failed. No retries permitted until 2026-07-10 20:21:53.423995594 +0000 UTC m=+34.884200415 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2957" (UniqueName: "kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957") pod "network-check-target-rj4l7" (UID: "bef08af3-bb5b-4bf3-97a1-0afdb5a63735") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:37.654994 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:37.654962 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:37.655211 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:37.655083 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:38.654909 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:38.654869 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:38.655102 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:38.654869 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:38.655102 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:38.654991 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:38.655210 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:38.655093 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:39.655668 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:39.655631 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:39.656123 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:39.655744 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:40.654954 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:40.654914 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:40.655119 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:40.654960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:40.655119 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:40.655052 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:40.655265 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:40.655198 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:41.654600 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.654407 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:41.655364 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:41.654679 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:41.750831 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.750765 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" event={"ID":"50b711c2-8a0a-424b-a81f-472c99fed309","Type":"ContainerStarted","Data":"ab403be3401104271f3df754de05c9abb84ded3ef18320c866f328034a655a33"} Jul 10 20:21:41.752527 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.752498 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nrjmp" event={"ID":"439772ec-a894-482d-95aa-449e9db39ca7","Type":"ContainerStarted","Data":"0ffccb3ba644f3967b92bea1179f0cf72fdc7b1585147bc5f7604300a0b196e4"} Jul 10 20:21:41.754342 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.754314 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hbr6v" event={"ID":"feb78f8a-7e80-4546-a840-3d15bc2dba14","Type":"ContainerStarted","Data":"bc030e14722684a157b3cf261310a440517af40b922589e51a71157a938db3db"} Jul 10 20:21:41.756420 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.756385 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" event={"ID":"91ef7c3a-87b9-4601-ae24-0dc1fbc00153","Type":"ContainerStarted","Data":"c808e60872baaa932ff297015cc3ad522e13e18bc8a5ee664bcc6519330a5bca"} Jul 10 20:21:41.758113 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.757752 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dlpg8" event={"ID":"8f7b5179-aa27-496e-9181-5c85edf27e29","Type":"ContainerStarted","Data":"cbcf954bbf0069d451ede53be12a52beeeedf078c3a2291d76debf825578a606"} Jul 10 20:21:41.759500 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.759483 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:21:41.759863 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.759843 2580 generic.go:356] "Generic (PLEG): container finished" podID="54408f7e-c518-4ea9-943f-f77237ea1102" containerID="8d497aa3fb9e619b95e7c814e1509b72c5a04237aa31c8bf7449203893ed7c5c" exitCode=1 Jul 10 20:21:41.759935 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.759908 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" event={"ID":"54408f7e-c518-4ea9-943f-f77237ea1102","Type":"ContainerDied","Data":"8d497aa3fb9e619b95e7c814e1509b72c5a04237aa31c8bf7449203893ed7c5c"} Jul 10 20:21:41.759999 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.759983 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" event={"ID":"54408f7e-c518-4ea9-943f-f77237ea1102","Type":"ContainerStarted","Data":"9a8f0fa35ab951702ed3077260d6394d0b1e31f0db995596a5c9a9abaae3b3a5"} Jul 10 20:21:41.761242 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.761222 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tq429" event={"ID":"e4c479fa-abe8-4123-a651-449f41f51e85","Type":"ContainerStarted","Data":"3e05a2b14baf003aefc0416b75063a345147bdc2e0118d72618c9eaa0442f701"} Jul 10 20:21:41.762686 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.762664 2580 generic.go:356] "Generic (PLEG): container finished" podID="52d41eb6-7de4-4fd7-8ee6-fd0397982de4" containerID="3085ce340ec1928cf5eb740fbd0d94a6aec36b64ff8cb844ebce32a64434b771" exitCode=0 Jul 10 20:21:41.762789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.762694 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgcl5" event={"ID":"52d41eb6-7de4-4fd7-8ee6-fd0397982de4","Type":"ContainerDied","Data":"3085ce340ec1928cf5eb740fbd0d94a6aec36b64ff8cb844ebce32a64434b771"} Jul 10 20:21:41.766437 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.766274 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-6.ec2.internal" podStartSLOduration=21.766260466 podStartE2EDuration="21.766260466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:24.732880431 +0000 UTC m=+6.193085255" watchObservedRunningTime="2026-07-10 20:21:41.766260466 +0000 UTC m=+23.226465294" Jul 10 20:21:41.790770 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.790727 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6ms2x" podStartSLOduration=4.012939336 podStartE2EDuration="22.790712125s" totalImagesPullingTime="18.777772789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:41.766521307 +0000 UTC m=+23.226726134" watchObservedRunningTime="2026-07-10 20:21:41.790712125 +0000 UTC m=+23.250916951" Jul 10 20:21:41.806186 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.806145 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tq429" podStartSLOduration=4.047349868 podStartE2EDuration="22.806112344s" totalImagesPullingTime="18.758762476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:41.805963739 +0000 UTC m=+23.266168562" watchObservedRunningTime="2026-07-10 20:21:41.806112344 +0000 UTC m=+23.266317170" Jul 10 20:21:41.818724 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.818672 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dlpg8" podStartSLOduration=4.050755521 podStartE2EDuration="22.818655297s" totalImagesPullingTime="18.767899776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:41.818623756 +0000 UTC m=+23.278828593" watchObservedRunningTime="2026-07-10 20:21:41.818655297 +0000 UTC m=+23.278860124" Jul 10 20:21:41.833782 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.833741 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hbr6v" podStartSLOduration=4.023199002 podStartE2EDuration="22.833728551s" totalImagesPullingTime="18.810529549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:41.833251711 +0000 UTC m=+23.293456537" watchObservedRunningTime="2026-07-10 20:21:41.833728551 +0000 UTC m=+23.293933425" Jul 10 20:21:41.845956 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:41.845874 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nrjmp" podStartSLOduration=12.13726049 podStartE2EDuration="22.845857793s" totalImagesPullingTime="10.708597303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:41.845830701 +0000 UTC m=+23.306035521" watchObservedRunningTime="2026-07-10 20:21:41.845857793 +0000 UTC m=+23.306062617" Jul 10 20:21:42.654360 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:42.654323 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:42.654474 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:42.654367 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:42.654551 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:42.654465 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:42.654670 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:42.654642 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:42.734291 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:42.734241 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 20:21:42.766454 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:42.766426 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" event={"ID":"91ef7c3a-87b9-4601-ae24-0dc1fbc00153","Type":"ContainerStarted","Data":"38627963fd8dccbe99692ed8510a880d100dfded6b9f6189e4e11b84c44c87d0"} Jul 10 20:21:42.768986 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:42.768968 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:21:42.769333 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:42.769310 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" event={"ID":"54408f7e-c518-4ea9-943f-f77237ea1102","Type":"ContainerStarted","Data":"f2761435fa7501f456c3cf3fbee1f0c663ddbff3662d03daf42b8d9cb9935bd6"} Jul 10 20:21:42.769410 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:42.769383 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" event={"ID":"54408f7e-c518-4ea9-943f-f77237ea1102","Type":"ContainerStarted","Data":"73f47acabf1f3de3dd17aeeda86ab478fd30b0f868b4f71a096ac49be07eb68f"} Jul 10 20:21:42.769469 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:42.769428 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" event={"ID":"54408f7e-c518-4ea9-943f-f77237ea1102","Type":"ContainerStarted","Data":"35447997c5a720a331bd7b44a3b68090df6515fd691a00bfccb5017d5191f6bf"} Jul 10 20:21:42.769511 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:42.769472 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" event={"ID":"54408f7e-c518-4ea9-943f-f77237ea1102","Type":"ContainerStarted","Data":"a338985f0ab930603713a2f39261f004eb3c8c38dd03706eee1663859ce34e5f"} Jul 10 20:21:42.770685 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:42.770638 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rdjhx" event={"ID":"a15649ba-69b0-4cee-b67d-401af3ab4368","Type":"ContainerStarted","Data":"7bf20e7935bfdaa942b942aef056282dda8c8840f8e64e300f7265c78e8fde75"} Jul 10 20:21:42.783627 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:42.783592 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rdjhx" podStartSLOduration=5.023018641 podStartE2EDuration="23.783580445s" totalImagesPullingTime="18.760561804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:42.78354396 +0000 UTC m=+24.243748783" watchObservedRunningTime="2026-07-10 20:21:42.783580445 +0000 UTC m=+24.243785270" Jul 10 20:21:43.532035 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:43.531928 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T20:21:42.734261647Z","UUID":"54c75558-efe9-4155-bb13-64b00ad6f666","Handler":null,"Name":"","Endpoint":""} Jul 10 20:21:43.533987 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:43.533960 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 20:21:43.534109 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:43.534002 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 20:21:43.654839 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:43.654809 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:43.655334 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:43.654956 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:44.654523 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:44.654491 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:44.654808 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:44.654616 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:44.654808 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:44.654680 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:44.654808 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:44.654797 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:44.778040 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:44.777997 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" event={"ID":"91ef7c3a-87b9-4601-ae24-0dc1fbc00153","Type":"ContainerStarted","Data":"06b007ed9035e28ed1d4690e8bf0bc07b812169811c5e0bae7b61c70324ae9cc"} Jul 10 20:21:44.782443 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:44.782276 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:21:44.782811 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:44.782782 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" event={"ID":"54408f7e-c518-4ea9-943f-f77237ea1102","Type":"ContainerStarted","Data":"98276ca75c5ec047d6f6b3afae7ffa1e388ef79a57358fbe2be8fd34fe5dc3bb"} Jul 10 20:21:44.794149 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:44.794084 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rtllp" podStartSLOduration=4.824657335 podStartE2EDuration="25.794068602s" totalImagesPullingTime="20.969411267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:44.793943859 +0000 UTC m=+26.254148688" watchObservedRunningTime="2026-07-10 20:21:44.794068602 +0000 UTC m=+26.254273428" Jul 10 20:21:45.304035 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:45.304000 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nrjmp" Jul 10 20:21:45.304665 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:45.304643 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nrjmp" Jul 10 20:21:45.654971 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:45.654936 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:45.655499 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:45.655085 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:45.785350 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:45.785247 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nrjmp" Jul 10 20:21:45.785814 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:45.785792 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nrjmp" Jul 10 20:21:46.654681 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:46.654509 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:46.654841 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:46.654509 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:46.654841 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:46.654751 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:46.654841 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:46.654818 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:46.790381 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:46.790353 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:21:46.791201 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:46.790726 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" event={"ID":"54408f7e-c518-4ea9-943f-f77237ea1102","Type":"ContainerStarted","Data":"995dfbe38482b640318e6ed8725b6ccafb7075485937f3e997b2f3ad10407dd6"} Jul 10 20:21:46.791201 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:46.790946 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:46.791286 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:46.791231 2580 scope.go:117] "RemoveContainer" containerID="8d497aa3fb9e619b95e7c814e1509b72c5a04237aa31c8bf7449203893ed7c5c" Jul 10 20:21:46.793374 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:46.793349 2580 generic.go:356] "Generic (PLEG): container finished" podID="52d41eb6-7de4-4fd7-8ee6-fd0397982de4" containerID="c392616b4d67ae1b57a245b781100fde632550c00cdf1da964265b7baf27d719" exitCode=0 Jul 10 20:21:46.793480 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:46.793426 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgcl5" event={"ID":"52d41eb6-7de4-4fd7-8ee6-fd0397982de4","Type":"ContainerDied","Data":"c392616b4d67ae1b57a245b781100fde632550c00cdf1da964265b7baf27d719"} Jul 10 20:21:46.808713 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:46.808693 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:47.658875 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:47.658848 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:47.659077 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:47.658980 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:47.800429 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:47.800394 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:21:47.802712 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:47.802687 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" event={"ID":"54408f7e-c518-4ea9-943f-f77237ea1102","Type":"ContainerStarted","Data":"308c69bf1962407d8000d377115a68553bf4255d69b952ee576930f643ba1219"} Jul 10 20:21:47.802888 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:47.802874 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:47.802953 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:47.802943 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:47.824042 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:47.824014 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:21:47.855591 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:47.855545 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" podStartSLOduration=10.01815682 podStartE2EDuration="28.855529507s" totalImagesPullingTime="18.837372687s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:47.833243827 +0000 UTC m=+29.293448647" watchObservedRunningTime="2026-07-10 20:21:47.855529507 +0000 UTC m=+29.315734332" Jul 10 20:21:48.429749 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:48.429716 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gsjgb"] Jul 10 20:21:48.429908 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:48.429866 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:48.429998 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:48.429980 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:48.432646 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:48.432621 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cgjgd"] Jul 10 20:21:48.432754 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:48.432739 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:48.432868 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:48.432846 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:48.433180 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:48.433157 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rj4l7"] Jul 10 20:21:48.433256 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:48.433240 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:48.433328 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:48.433308 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:48.805573 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:48.805535 2580 generic.go:356] "Generic (PLEG): container finished" podID="52d41eb6-7de4-4fd7-8ee6-fd0397982de4" containerID="36fe3d9bb043b9bd25cc54d29f8c640212e9a81e3c6d842c704d3e8f14fd1baf" exitCode=0 Jul 10 20:21:48.806087 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:48.805619 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgcl5" event={"ID":"52d41eb6-7de4-4fd7-8ee6-fd0397982de4","Type":"ContainerDied","Data":"36fe3d9bb043b9bd25cc54d29f8c640212e9a81e3c6d842c704d3e8f14fd1baf"} Jul 10 20:21:49.655293 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:49.655256 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:49.655457 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:49.655357 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:49.655457 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:49.655441 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:49.655571 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:49.655550 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:50.654472 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:50.654245 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:50.654836 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:50.654509 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:50.813282 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:50.813250 2580 generic.go:356] "Generic (PLEG): container finished" podID="52d41eb6-7de4-4fd7-8ee6-fd0397982de4" containerID="ca22aa0650f2acef3ef9c8a91b8a3e7cc45e4e9d46c09b65fa4a467a2c25bb03" exitCode=0 Jul 10 20:21:50.813425 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:50.813289 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgcl5" event={"ID":"52d41eb6-7de4-4fd7-8ee6-fd0397982de4","Type":"ContainerDied","Data":"ca22aa0650f2acef3ef9c8a91b8a3e7cc45e4e9d46c09b65fa4a467a2c25bb03"} Jul 10 20:21:51.654614 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:51.654582 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:51.655183 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:51.654581 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:51.655183 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:51.654684 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:51.655183 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:51.654746 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:52.654586 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:52.654557 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:52.654753 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:52.654690 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:53.342680 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:53.342589 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs\") pod \"network-metrics-daemon-gsjgb\" (UID: \"1d2a9a56-7498-4287-92d4-d6805d7fefa4\") " pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:53.342844 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:53.342655 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret\") pod \"global-pull-secret-syncer-cgjgd\" (UID: \"54004500-c887-4445-ba31-1c7db58bbb4d\") " pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:53.342844 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:53.342758 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:53.342844 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:53.342786 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:53.342970 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:53.342876 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret podName:54004500-c887-4445-ba31-1c7db58bbb4d nodeName:}" failed. No retries permitted until 2026-07-10 20:22:25.342828997 +0000 UTC m=+66.803033805 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret") pod "global-pull-secret-syncer-cgjgd" (UID: "54004500-c887-4445-ba31-1c7db58bbb4d") : object "kube-system"/"original-pull-secret" not registered Jul 10 20:21:53.342970 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:53.342938 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs podName:1d2a9a56-7498-4287-92d4-d6805d7fefa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:22:25.342928206 +0000 UTC m=+66.803133010 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs") pod "network-metrics-daemon-gsjgb" (UID: "1d2a9a56-7498-4287-92d4-d6805d7fefa4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 20:21:53.443352 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:53.443318 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2957\" (UniqueName: \"kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957\") pod \"network-check-target-rj4l7\" (UID: \"bef08af3-bb5b-4bf3-97a1-0afdb5a63735\") " pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:53.443579 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:53.443557 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 20:21:53.443657 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:53.443585 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 20:21:53.443657 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:53.443608 2580 projected.go:196] Error preparing data for projected volume kube-api-access-r2957 for pod openshift-network-diagnostics/network-check-target-rj4l7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:53.443757 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:53.443671 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957 podName:bef08af3-bb5b-4bf3-97a1-0afdb5a63735 nodeName:}" failed. No retries permitted until 2026-07-10 20:22:25.443650115 +0000 UTC m=+66.903854936 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r2957" (UniqueName: "kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957") pod "network-check-target-rj4l7" (UID: "bef08af3-bb5b-4bf3-97a1-0afdb5a63735") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 20:21:53.654599 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:53.654561 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:53.654766 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:53.654561 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:53.654766 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:53.654693 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj4l7" podUID="bef08af3-bb5b-4bf3-97a1-0afdb5a63735" Jul 10 20:21:53.654766 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:53.654749 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cgjgd" podUID="54004500-c887-4445-ba31-1c7db58bbb4d" Jul 10 20:21:54.654369 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:54.654327 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:54.654547 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:54.654459 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:21:55.295166 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.295120 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-6.ec2.internal" event="NodeReady" Jul 10 20:21:55.295614 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.295260 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 20:21:55.340516 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.340480 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xjz7l"] Jul 10 20:21:55.351954 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.351911 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-scdn6"] Jul 10 20:21:55.352090 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.352051 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xjz7l" Jul 10 20:21:55.354859 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.354834 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 20:21:55.354989 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.354859 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 20:21:55.355393 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.355371 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sgw85\"" Jul 10 20:21:55.376105 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.376083 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-scdn6"] Jul 10 20:21:55.376241 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.376111 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xjz7l"] Jul 10 20:21:55.376241 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.376217 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-scdn6" Jul 10 20:21:55.378584 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.378563 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 20:21:55.378584 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.378578 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 20:21:55.378738 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.378637 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xpb5f\"" Jul 10 20:21:55.378738 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.378564 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 20:21:55.459396 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.459359 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:21:55.459396 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.459397 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9zbk\" (UniqueName: \"kubernetes.io/projected/f14f7f56-76e3-419f-8465-2f708f109e31-kube-api-access-n9zbk\") pod \"ingress-canary-scdn6\" (UID: \"f14f7f56-76e3-419f-8465-2f708f109e31\") " pod="openshift-ingress-canary/ingress-canary-scdn6" Jul 10 20:21:55.459587 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.459468 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-tmp-dir\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:21:55.459587 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.459486 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-config-volume\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:21:55.459587 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.459559 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f14f7f56-76e3-419f-8465-2f708f109e31-cert\") pod \"ingress-canary-scdn6\" (UID: \"f14f7f56-76e3-419f-8465-2f708f109e31\") " pod="openshift-ingress-canary/ingress-canary-scdn6" Jul 10 20:21:55.459587 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.459580 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7dwf\" (UniqueName: \"kubernetes.io/projected/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-kube-api-access-q7dwf\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:21:55.559901 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.559812 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f14f7f56-76e3-419f-8465-2f708f109e31-cert\") pod \"ingress-canary-scdn6\" (UID: \"f14f7f56-76e3-419f-8465-2f708f109e31\") " pod="openshift-ingress-canary/ingress-canary-scdn6" Jul 10 20:21:55.559901 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.559858 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7dwf\" (UniqueName: \"kubernetes.io/projected/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-kube-api-access-q7dwf\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:21:55.559901 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.559883 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:21:55.560208 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.559939 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9zbk\" (UniqueName: \"kubernetes.io/projected/f14f7f56-76e3-419f-8465-2f708f109e31-kube-api-access-n9zbk\") pod \"ingress-canary-scdn6\" (UID: \"f14f7f56-76e3-419f-8465-2f708f109e31\") " pod="openshift-ingress-canary/ingress-canary-scdn6" Jul 10 20:21:55.560208 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:55.559992 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:21:55.560208 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.560022 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-tmp-dir\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:21:55.560208 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:55.560055 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls podName:c32bbb4b-0f56-4f0c-971e-660dd1b6f01c nodeName:}" failed. No retries permitted until 2026-07-10 20:21:56.060035805 +0000 UTC m=+37.520240632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls") pod "dns-default-xjz7l" (UID: "c32bbb4b-0f56-4f0c-971e-660dd1b6f01c") : secret "dns-default-metrics-tls" not found Jul 10 20:21:55.560208 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.560071 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-config-volume\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:21:55.560453 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.560374 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-tmp-dir\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:21:55.560661 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.560644 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-config-volume\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:21:55.564454 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.564432 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f14f7f56-76e3-419f-8465-2f708f109e31-cert\") pod \"ingress-canary-scdn6\" (UID: \"f14f7f56-76e3-419f-8465-2f708f109e31\") " pod="openshift-ingress-canary/ingress-canary-scdn6" Jul 10 20:21:55.568500 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.568478 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7dwf\" (UniqueName: \"kubernetes.io/projected/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-kube-api-access-q7dwf\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:21:55.568749 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.568730 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9zbk\" (UniqueName: \"kubernetes.io/projected/f14f7f56-76e3-419f-8465-2f708f109e31-kube-api-access-n9zbk\") pod \"ingress-canary-scdn6\" (UID: \"f14f7f56-76e3-419f-8465-2f708f109e31\") " pod="openshift-ingress-canary/ingress-canary-scdn6" Jul 10 20:21:55.655167 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.654903 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:21:55.655335 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.654979 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:21:55.658168 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.658003 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pk8lx\"" Jul 10 20:21:55.658168 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.658024 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 20:21:55.658168 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.658093 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 20:21:55.658552 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.658534 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 20:21:55.683836 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.683813 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-scdn6" Jul 10 20:21:55.828173 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.828121 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgcl5" event={"ID":"52d41eb6-7de4-4fd7-8ee6-fd0397982de4","Type":"ContainerStarted","Data":"86ebd4eae263e8c5e2fe5bb9af0be3d651bf66bb0ca404c091131095b40c63e3"} Jul 10 20:21:55.896623 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:55.896580 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-scdn6"] Jul 10 20:21:55.901831 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:21:55.901798 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf14f7f56_76e3_419f_8465_2f708f109e31.slice/crio-360cca3316a8115295d4de0a877c7ffcbac7c6761146e7a96e3993711eb6d158 WatchSource:0}: Error finding container 360cca3316a8115295d4de0a877c7ffcbac7c6761146e7a96e3993711eb6d158: Status 404 returned error can't find the container with id 360cca3316a8115295d4de0a877c7ffcbac7c6761146e7a96e3993711eb6d158 Jul 10 20:21:56.063297 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:56.063210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:21:56.063443 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:56.063358 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:21:56.063443 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:56.063423 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls podName:c32bbb4b-0f56-4f0c-971e-660dd1b6f01c nodeName:}" failed. No retries permitted until 2026-07-10 20:21:57.063408066 +0000 UTC m=+38.523612869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls") pod "dns-default-xjz7l" (UID: "c32bbb4b-0f56-4f0c-971e-660dd1b6f01c") : secret "dns-default-metrics-tls" not found Jul 10 20:21:56.654826 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:56.654799 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:21:56.657258 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:56.657194 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 20:21:56.657258 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:56.657225 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mr56z\"" Jul 10 20:21:56.832247 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:56.832167 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-scdn6" event={"ID":"f14f7f56-76e3-419f-8465-2f708f109e31","Type":"ContainerStarted","Data":"360cca3316a8115295d4de0a877c7ffcbac7c6761146e7a96e3993711eb6d158"} Jul 10 20:21:56.835234 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:56.835204 2580 generic.go:356] "Generic (PLEG): container finished" podID="52d41eb6-7de4-4fd7-8ee6-fd0397982de4" containerID="86ebd4eae263e8c5e2fe5bb9af0be3d651bf66bb0ca404c091131095b40c63e3" exitCode=0 Jul 10 20:21:56.835352 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:56.835245 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgcl5" event={"ID":"52d41eb6-7de4-4fd7-8ee6-fd0397982de4","Type":"ContainerDied","Data":"86ebd4eae263e8c5e2fe5bb9af0be3d651bf66bb0ca404c091131095b40c63e3"} Jul 10 20:21:57.070743 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:57.070541 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:21:57.070933 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:57.070680 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:21:57.070933 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:57.070894 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls podName:c32bbb4b-0f56-4f0c-971e-660dd1b6f01c nodeName:}" failed. No retries permitted until 2026-07-10 20:21:59.070862642 +0000 UTC m=+40.531067463 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls") pod "dns-default-xjz7l" (UID: "c32bbb4b-0f56-4f0c-971e-660dd1b6f01c") : secret "dns-default-metrics-tls" not found Jul 10 20:21:57.840667 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:57.840628 2580 generic.go:356] "Generic (PLEG): container finished" podID="52d41eb6-7de4-4fd7-8ee6-fd0397982de4" containerID="839c2c837ff661a8b84b085609a77fa11d537f62d6d3e3aa8e7de866e6c61e29" exitCode=0 Jul 10 20:21:57.841149 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:57.840672 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgcl5" event={"ID":"52d41eb6-7de4-4fd7-8ee6-fd0397982de4","Type":"ContainerDied","Data":"839c2c837ff661a8b84b085609a77fa11d537f62d6d3e3aa8e7de866e6c61e29"} Jul 10 20:21:58.844787 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:58.844688 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-scdn6" event={"ID":"f14f7f56-76e3-419f-8465-2f708f109e31","Type":"ContainerStarted","Data":"f9dda2b5bb9883d0da4b49aa63b8707247623e20eb2485c5101b2f8e22714530"} Jul 10 20:21:58.847972 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:58.847948 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cgcl5" event={"ID":"52d41eb6-7de4-4fd7-8ee6-fd0397982de4","Type":"ContainerStarted","Data":"0afde6ccb4b0926c4d26560e9ce46d4a627cd25147e23213fb7983aa4d4d86ec"} Jul 10 20:21:58.858703 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:58.858659 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-scdn6" podStartSLOduration=1.291442679 podStartE2EDuration="3.8586461s" totalImagesPullingTime="2.567203421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:21:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:58.858061749 +0000 UTC m=+40.318266574" watchObservedRunningTime="2026-07-10 20:21:58.8586461 +0000 UTC m=+40.318850927" Jul 10 20:21:58.877853 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:58.877806 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cgcl5" podStartSLOduration=9.533378274 podStartE2EDuration="39.877786546s" totalImagesPullingTime="30.344408272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:21:58.8767098 +0000 UTC m=+40.336914626" watchObservedRunningTime="2026-07-10 20:21:58.877786546 +0000 UTC m=+40.337991391" Jul 10 20:21:59.088044 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:21:59.087987 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:21:59.088254 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:59.088163 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:21:59.088254 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:21:59.088222 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls podName:c32bbb4b-0f56-4f0c-971e-660dd1b6f01c nodeName:}" failed. No retries permitted until 2026-07-10 20:22:03.088206172 +0000 UTC m=+44.548410990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls") pod "dns-default-xjz7l" (UID: "c32bbb4b-0f56-4f0c-971e-660dd1b6f01c") : secret "dns-default-metrics-tls" not found Jul 10 20:22:03.117520 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:03.117478 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:22:03.117894 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:22:03.117659 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:22:03.117894 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:22:03.117782 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls podName:c32bbb4b-0f56-4f0c-971e-660dd1b6f01c nodeName:}" failed. No retries permitted until 2026-07-10 20:22:11.11776545 +0000 UTC m=+52.577970254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls") pod "dns-default-xjz7l" (UID: "c32bbb4b-0f56-4f0c-971e-660dd1b6f01c") : secret "dns-default-metrics-tls" not found Jul 10 20:22:11.174556 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:11.174517 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:22:11.175045 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:22:11.174678 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:22:11.175045 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:22:11.174770 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls podName:c32bbb4b-0f56-4f0c-971e-660dd1b6f01c nodeName:}" failed. No retries permitted until 2026-07-10 20:22:27.174749033 +0000 UTC m=+68.634953854 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls") pod "dns-default-xjz7l" (UID: "c32bbb4b-0f56-4f0c-971e-660dd1b6f01c") : secret "dns-default-metrics-tls" not found Jul 10 20:22:19.818116 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:19.818090 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-n9x79" Jul 10 20:22:25.365169 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:25.365112 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret\") pod \"global-pull-secret-syncer-cgjgd\" (UID: \"54004500-c887-4445-ba31-1c7db58bbb4d\") " pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:22:25.365680 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:25.365204 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs\") pod \"network-metrics-daemon-gsjgb\" (UID: \"1d2a9a56-7498-4287-92d4-d6805d7fefa4\") " pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:22:25.367776 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:25.367760 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 20:22:25.367973 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:25.367954 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 20:22:25.375893 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:22:25.375872 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 20:22:25.375962 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:22:25.375942 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs podName:1d2a9a56-7498-4287-92d4-d6805d7fefa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:23:29.375925687 +0000 UTC m=+130.836130491 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs") pod "network-metrics-daemon-gsjgb" (UID: "1d2a9a56-7498-4287-92d4-d6805d7fefa4") : secret "metrics-daemon-secret" not found Jul 10 20:22:25.379384 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:25.379356 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54004500-c887-4445-ba31-1c7db58bbb4d-original-pull-secret\") pod \"global-pull-secret-syncer-cgjgd\" (UID: \"54004500-c887-4445-ba31-1c7db58bbb4d\") " pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:22:25.386339 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:25.386321 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cgjgd" Jul 10 20:22:25.465815 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:25.465788 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2957\" (UniqueName: \"kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957\") pod \"network-check-target-rj4l7\" (UID: \"bef08af3-bb5b-4bf3-97a1-0afdb5a63735\") " pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:22:25.468462 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:25.468443 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 20:22:25.478387 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:25.478363 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 20:22:25.489519 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:25.489489 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2957\" (UniqueName: \"kubernetes.io/projected/bef08af3-bb5b-4bf3-97a1-0afdb5a63735-kube-api-access-r2957\") pod \"network-check-target-rj4l7\" (UID: \"bef08af3-bb5b-4bf3-97a1-0afdb5a63735\") " pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:22:25.501658 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:25.501633 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cgjgd"] Jul 10 20:22:25.504867 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:22:25.504841 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54004500_c887_4445_ba31_1c7db58bbb4d.slice/crio-382bc23ef20fab13de9b55f762874363d142e5901cd2b49cc13c9e70aed56163 WatchSource:0}: Error finding container 382bc23ef20fab13de9b55f762874363d142e5901cd2b49cc13c9e70aed56163: Status 404 returned error can't find the container with id 382bc23ef20fab13de9b55f762874363d142e5901cd2b49cc13c9e70aed56163 Jul 10 20:22:25.670379 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:25.670349 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pk8lx\"" Jul 10 20:22:25.678743 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:25.678716 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:22:25.797903 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:25.797871 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rj4l7"] Jul 10 20:22:25.801847 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:22:25.801818 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbef08af3_bb5b_4bf3_97a1_0afdb5a63735.slice/crio-9c70f50c4c4896227286975176455a4001c07270e13a47f2ac8999486f30578c WatchSource:0}: Error finding container 9c70f50c4c4896227286975176455a4001c07270e13a47f2ac8999486f30578c: Status 404 returned error can't find the container with id 9c70f50c4c4896227286975176455a4001c07270e13a47f2ac8999486f30578c Jul 10 20:22:25.912828 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:25.912794 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rj4l7" event={"ID":"bef08af3-bb5b-4bf3-97a1-0afdb5a63735","Type":"ContainerStarted","Data":"9c70f50c4c4896227286975176455a4001c07270e13a47f2ac8999486f30578c"} Jul 10 20:22:25.913777 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:25.913754 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cgjgd" event={"ID":"54004500-c887-4445-ba31-1c7db58bbb4d","Type":"ContainerStarted","Data":"382bc23ef20fab13de9b55f762874363d142e5901cd2b49cc13c9e70aed56163"} Jul 10 20:22:27.178492 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:27.178451 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:22:27.178889 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:22:27.178601 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:22:27.178889 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:22:27.178684 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls podName:c32bbb4b-0f56-4f0c-971e-660dd1b6f01c nodeName:}" failed. No retries permitted until 2026-07-10 20:22:59.178664869 +0000 UTC m=+100.638869687 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls") pod "dns-default-xjz7l" (UID: "c32bbb4b-0f56-4f0c-971e-660dd1b6f01c") : secret "dns-default-metrics-tls" not found Jul 10 20:22:30.928887 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:30.928851 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rj4l7" event={"ID":"bef08af3-bb5b-4bf3-97a1-0afdb5a63735","Type":"ContainerStarted","Data":"496791eea8d1f70123e75d8a89e93be9332da3049d7cbc1a6b6417755d564d50"} Jul 10 20:22:30.929277 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:30.928979 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:22:30.946457 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:30.946410 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rj4l7" podStartSLOduration=66.99377663 podStartE2EDuration="1m11.946390846s" totalImagesPullingTime="4.952614216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:22:30.94579317 +0000 UTC m=+72.405997996" watchObservedRunningTime="2026-07-10 20:22:30.946390846 +0000 UTC m=+72.406595674" Jul 10 20:22:31.938043 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:31.938009 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cgjgd" event={"ID":"54004500-c887-4445-ba31-1c7db58bbb4d","Type":"ContainerStarted","Data":"1b3572f4e7efba6609b14d3437021544e5bffed584a6e9ed2fb0039ebf684731"} Jul 10 20:22:31.953434 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:31.953377 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cgjgd" podStartSLOduration=67.692355066 podStartE2EDuration="1m12.953356155s" totalImagesPullingTime="5.261001089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:22:31.953111903 +0000 UTC m=+73.413316731" watchObservedRunningTime="2026-07-10 20:22:31.953356155 +0000 UTC m=+73.413560982" Jul 10 20:22:59.205727 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:22:59.205678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:22:59.206185 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:22:59.205868 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:22:59.206185 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:22:59.205954 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls podName:c32bbb4b-0f56-4f0c-971e-660dd1b6f01c nodeName:}" failed. No retries permitted until 2026-07-10 20:24:03.205936222 +0000 UTC m=+164.666141026 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls") pod "dns-default-xjz7l" (UID: "c32bbb4b-0f56-4f0c-971e-660dd1b6f01c") : secret "dns-default-metrics-tls" not found Jul 10 20:23:01.940874 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:23:01.940847 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rj4l7" Jul 10 20:23:29.409515 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:23:29.409469 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs\") pod \"network-metrics-daemon-gsjgb\" (UID: \"1d2a9a56-7498-4287-92d4-d6805d7fefa4\") " pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:23:29.409987 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:23:29.409627 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 20:23:29.409987 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:23:29.409689 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs podName:1d2a9a56-7498-4287-92d4-d6805d7fefa4 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:31.409673477 +0000 UTC m=+252.869878284 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs") pod "network-metrics-daemon-gsjgb" (UID: "1d2a9a56-7498-4287-92d4-d6805d7fefa4") : secret "metrics-daemon-secret" not found Jul 10 20:23:58.362054 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:23:58.361944 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xjz7l" podUID="c32bbb4b-0f56-4f0c-971e-660dd1b6f01c" Jul 10 20:23:59.139335 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:23:59.139300 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xjz7l" Jul 10 20:23:59.665142 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:23:59.665093 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gsjgb" podUID="1d2a9a56-7498-4287-92d4-d6805d7fefa4" Jul 10 20:24:03.248510 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:24:03.248453 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:24:03.248967 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:24:03.248614 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 20:24:03.248967 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:24:03.248682 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls podName:c32bbb4b-0f56-4f0c-971e-660dd1b6f01c nodeName:}" failed. No retries permitted until 2026-07-10 20:26:05.248665016 +0000 UTC m=+286.708869820 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls") pod "dns-default-xjz7l" (UID: "c32bbb4b-0f56-4f0c-971e-660dd1b6f01c") : secret "dns-default-metrics-tls" not found Jul 10 20:24:10.654475 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:24:10.654374 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:25:03.573428 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.573385 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jxkh6"] Jul 10 20:25:03.575345 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.575325 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78b9d75b5b-wfpbd"] Jul 10 20:25:03.575477 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.575455 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jxkh6" Jul 10 20:25:03.576866 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.576851 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.577977 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.577958 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 10 20:25:03.578207 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.578193 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 10 20:25:03.580966 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.580935 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7gwpp\"" Jul 10 20:25:03.581173 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.581158 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 20:25:03.581252 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.581218 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 20:25:03.581252 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.581225 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 20:25:03.581357 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.581256 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s5ppj\"" Jul 10 20:25:03.585963 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.585940 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 20:25:03.591815 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.591793 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jxkh6"] Jul 10 20:25:03.597895 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.597870 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78b9d75b5b-wfpbd"] Jul 10 20:25:03.655023 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.654988 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.655023 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.655030 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fea9949-e4ff-45fc-982a-c634a1d9b074-trusted-ca\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.655288 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.655059 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fea9949-e4ff-45fc-982a-c634a1d9b074-installation-pull-secrets\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.655288 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.655083 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdd7q\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-kube-api-access-bdd7q\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.655288 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.655213 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfx5f\" (UniqueName: \"kubernetes.io/projected/87628fa9-06d0-42ae-a3aa-f5e2d2eedb83-kube-api-access-cfx5f\") pod \"volume-data-source-validator-78495597f6-jxkh6\" (UID: \"87628fa9-06d0-42ae-a3aa-f5e2d2eedb83\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jxkh6" Jul 10 20:25:03.655288 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.655262 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fea9949-e4ff-45fc-982a-c634a1d9b074-ca-trust-extracted\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.655462 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.655309 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fea9949-e4ff-45fc-982a-c634a1d9b074-image-registry-private-configuration\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.655462 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.655353 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-bound-sa-token\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.655462 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.655386 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-certificates\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.669576 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.669535 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc"] Jul 10 20:25:03.672713 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.672693 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9"] Jul 10 20:25:03.672843 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.672809 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc" Jul 10 20:25:03.675119 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.675097 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf"] Jul 10 20:25:03.675225 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.675196 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9" Jul 10 20:25:03.675303 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.675196 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 10 20:25:03.675445 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.675322 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 10 20:25:03.675445 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.675196 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m6gjf\"" Jul 10 20:25:03.675657 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.675639 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 10 20:25:03.677224 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.677207 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs"] Jul 10 20:25:03.677335 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.677321 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf" Jul 10 20:25:03.677675 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.677655 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 10 20:25:03.677823 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.677780 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2dg85\"" Jul 10 20:25:03.677997 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.677978 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 10 20:25:03.678300 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.678284 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 10 20:25:03.678636 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.678619 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 10 20:25:03.679446 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.679428 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" Jul 10 20:25:03.680623 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.680601 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 10 20:25:03.680816 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.680802 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 10 20:25:03.681200 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.681181 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 10 20:25:03.682667 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.682622 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 10 20:25:03.682767 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.682707 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 20:25:03.682767 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.682718 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 10 20:25:03.682867 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.682779 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-m5blc\"" Jul 10 20:25:03.682867 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.682724 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 20:25:03.683099 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.683086 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 10 20:25:03.683154 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.683100 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wxt4m\"" Jul 10 20:25:03.686213 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.686190 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc"] Jul 10 20:25:03.687048 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.687031 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf"] Jul 10 20:25:03.687725 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.687704 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9"] Jul 10 20:25:03.688528 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.688511 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs"] Jul 10 20:25:03.756165 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756112 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fea9949-e4ff-45fc-982a-c634a1d9b074-ca-trust-extracted\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.756165 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756168 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b80f7f0-7211-4304-8c64-fbb1a5981c73-serving-cert\") pod \"service-ca-operator-7695fc6c8c-l4hl9\" (UID: \"7b80f7f0-7211-4304-8c64-fbb1a5981c73\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9" Jul 10 20:25:03.756366 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756225 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fea9949-e4ff-45fc-982a-c634a1d9b074-image-registry-private-configuration\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.756366 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756250 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-bound-sa-token\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.756366 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756278 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dljgc\" (UID: \"15ce9a8c-4876-4789-9295-3cd290696c7e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc" Jul 10 20:25:03.756459 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756400 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d17091fb-5267-42d2-8683-3b26390a632b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-6qcbf\" (UID: \"d17091fb-5267-42d2-8683-3b26390a632b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf" Jul 10 20:25:03.756499 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756453 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-certificates\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.756499 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756486 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9792b3e3-4f2d-47fc-bd39-7678a663e757-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-jsrqs\" (UID: \"9792b3e3-4f2d-47fc-bd39-7678a663e757\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" Jul 10 20:25:03.756572 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756513 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jsrqs\" (UID: \"9792b3e3-4f2d-47fc-bd39-7678a663e757\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" Jul 10 20:25:03.756572 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756527 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fea9949-e4ff-45fc-982a-c634a1d9b074-ca-trust-extracted\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.756572 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756546 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b80f7f0-7211-4304-8c64-fbb1a5981c73-config\") pod \"service-ca-operator-7695fc6c8c-l4hl9\" (UID: \"7b80f7f0-7211-4304-8c64-fbb1a5981c73\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9" Jul 10 20:25:03.756708 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756592 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26qgj\" (UniqueName: \"kubernetes.io/projected/15ce9a8c-4876-4789-9295-3cd290696c7e-kube-api-access-26qgj\") pod \"cluster-samples-operator-65db858894-dljgc\" (UID: \"15ce9a8c-4876-4789-9295-3cd290696c7e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc" Jul 10 20:25:03.756708 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756631 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qwbh\" (UniqueName: \"kubernetes.io/projected/7b80f7f0-7211-4304-8c64-fbb1a5981c73-kube-api-access-5qwbh\") pod \"service-ca-operator-7695fc6c8c-l4hl9\" (UID: \"7b80f7f0-7211-4304-8c64-fbb1a5981c73\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9" Jul 10 20:25:03.756708 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756658 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.756708 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756676 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fea9949-e4ff-45fc-982a-c634a1d9b074-trusted-ca\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.756708 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756695 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gh4q\" (UniqueName: \"kubernetes.io/projected/9792b3e3-4f2d-47fc-bd39-7678a663e757-kube-api-access-7gh4q\") pod \"cluster-monitoring-operator-5f7f494dd4-jsrqs\" (UID: \"9792b3e3-4f2d-47fc-bd39-7678a663e757\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" Jul 10 20:25:03.756930 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756720 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fea9949-e4ff-45fc-982a-c634a1d9b074-installation-pull-secrets\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.756930 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756738 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdd7q\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-kube-api-access-bdd7q\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.756930 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:03.756743 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 20:25:03.756930 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:03.756756 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b9d75b5b-wfpbd: secret "image-registry-tls" not found Jul 10 20:25:03.756930 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756766 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d17091fb-5267-42d2-8683-3b26390a632b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-6qcbf\" (UID: \"d17091fb-5267-42d2-8683-3b26390a632b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf" Jul 10 20:25:03.756930 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:03.756804 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls podName:5fea9949-e4ff-45fc-982a-c634a1d9b074 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:04.256785626 +0000 UTC m=+225.716990430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls") pod "image-registry-78b9d75b5b-wfpbd" (UID: "5fea9949-e4ff-45fc-982a-c634a1d9b074") : secret "image-registry-tls" not found Jul 10 20:25:03.756930 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756847 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfx5f\" (UniqueName: \"kubernetes.io/projected/87628fa9-06d0-42ae-a3aa-f5e2d2eedb83-kube-api-access-cfx5f\") pod \"volume-data-source-validator-78495597f6-jxkh6\" (UID: \"87628fa9-06d0-42ae-a3aa-f5e2d2eedb83\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jxkh6" Jul 10 20:25:03.756930 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.756873 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl5lj\" (UniqueName: \"kubernetes.io/projected/d17091fb-5267-42d2-8683-3b26390a632b-kube-api-access-xl5lj\") pod \"kube-storage-version-migrator-operator-799cb7f958-6qcbf\" (UID: \"d17091fb-5267-42d2-8683-3b26390a632b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf" Jul 10 20:25:03.757359 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.757012 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-certificates\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.757533 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.757513 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fea9949-e4ff-45fc-982a-c634a1d9b074-trusted-ca\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.758752 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.758733 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fea9949-e4ff-45fc-982a-c634a1d9b074-image-registry-private-configuration\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.759057 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.759041 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fea9949-e4ff-45fc-982a-c634a1d9b074-installation-pull-secrets\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.768949 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.768919 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-bound-sa-token\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.771080 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.771051 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdd7q\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-kube-api-access-bdd7q\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:03.771339 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.771322 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfx5f\" (UniqueName: \"kubernetes.io/projected/87628fa9-06d0-42ae-a3aa-f5e2d2eedb83-kube-api-access-cfx5f\") pod \"volume-data-source-validator-78495597f6-jxkh6\" (UID: \"87628fa9-06d0-42ae-a3aa-f5e2d2eedb83\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jxkh6" Jul 10 20:25:03.857681 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.857582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gh4q\" (UniqueName: \"kubernetes.io/projected/9792b3e3-4f2d-47fc-bd39-7678a663e757-kube-api-access-7gh4q\") pod \"cluster-monitoring-operator-5f7f494dd4-jsrqs\" (UID: \"9792b3e3-4f2d-47fc-bd39-7678a663e757\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" Jul 10 20:25:03.857681 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.857627 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d17091fb-5267-42d2-8683-3b26390a632b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-6qcbf\" (UID: \"d17091fb-5267-42d2-8683-3b26390a632b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf" Jul 10 20:25:03.857681 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.857652 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl5lj\" (UniqueName: \"kubernetes.io/projected/d17091fb-5267-42d2-8683-3b26390a632b-kube-api-access-xl5lj\") pod \"kube-storage-version-migrator-operator-799cb7f958-6qcbf\" (UID: \"d17091fb-5267-42d2-8683-3b26390a632b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf" Jul 10 20:25:03.857681 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.857671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b80f7f0-7211-4304-8c64-fbb1a5981c73-serving-cert\") pod \"service-ca-operator-7695fc6c8c-l4hl9\" (UID: \"7b80f7f0-7211-4304-8c64-fbb1a5981c73\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9" Jul 10 20:25:03.858006 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.857789 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dljgc\" (UID: \"15ce9a8c-4876-4789-9295-3cd290696c7e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc" Jul 10 20:25:03.858006 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.857828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d17091fb-5267-42d2-8683-3b26390a632b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-6qcbf\" (UID: \"d17091fb-5267-42d2-8683-3b26390a632b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf" Jul 10 20:25:03.858006 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.857858 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9792b3e3-4f2d-47fc-bd39-7678a663e757-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-jsrqs\" (UID: \"9792b3e3-4f2d-47fc-bd39-7678a663e757\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" Jul 10 20:25:03.858006 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.857886 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jsrqs\" (UID: \"9792b3e3-4f2d-47fc-bd39-7678a663e757\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" Jul 10 20:25:03.858006 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.857915 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b80f7f0-7211-4304-8c64-fbb1a5981c73-config\") pod \"service-ca-operator-7695fc6c8c-l4hl9\" (UID: \"7b80f7f0-7211-4304-8c64-fbb1a5981c73\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9" Jul 10 20:25:03.858006 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:03.857914 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 20:25:03.858006 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:03.857972 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 20:25:03.858006 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:03.857997 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls podName:15ce9a8c-4876-4789-9295-3cd290696c7e nodeName:}" failed. No retries permitted until 2026-07-10 20:25:04.3579782 +0000 UTC m=+225.818183020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls") pod "cluster-samples-operator-65db858894-dljgc" (UID: "15ce9a8c-4876-4789-9295-3cd290696c7e") : secret "samples-operator-tls" not found Jul 10 20:25:03.858437 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:03.858028 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls podName:9792b3e3-4f2d-47fc-bd39-7678a663e757 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:04.358010846 +0000 UTC m=+225.818215667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jsrqs" (UID: "9792b3e3-4f2d-47fc-bd39-7678a663e757") : secret "cluster-monitoring-operator-tls" not found Jul 10 20:25:03.858437 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.858052 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26qgj\" (UniqueName: \"kubernetes.io/projected/15ce9a8c-4876-4789-9295-3cd290696c7e-kube-api-access-26qgj\") pod \"cluster-samples-operator-65db858894-dljgc\" (UID: \"15ce9a8c-4876-4789-9295-3cd290696c7e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc" Jul 10 20:25:03.858437 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.858091 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qwbh\" (UniqueName: \"kubernetes.io/projected/7b80f7f0-7211-4304-8c64-fbb1a5981c73-kube-api-access-5qwbh\") pod \"service-ca-operator-7695fc6c8c-l4hl9\" (UID: \"7b80f7f0-7211-4304-8c64-fbb1a5981c73\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9" Jul 10 20:25:03.858437 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.858436 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d17091fb-5267-42d2-8683-3b26390a632b-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-6qcbf\" (UID: \"d17091fb-5267-42d2-8683-3b26390a632b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf" Jul 10 20:25:03.858651 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.858542 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b80f7f0-7211-4304-8c64-fbb1a5981c73-config\") pod \"service-ca-operator-7695fc6c8c-l4hl9\" (UID: \"7b80f7f0-7211-4304-8c64-fbb1a5981c73\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9" Jul 10 20:25:03.858705 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.858681 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9792b3e3-4f2d-47fc-bd39-7678a663e757-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-jsrqs\" (UID: \"9792b3e3-4f2d-47fc-bd39-7678a663e757\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" Jul 10 20:25:03.860505 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.860484 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b80f7f0-7211-4304-8c64-fbb1a5981c73-serving-cert\") pod \"service-ca-operator-7695fc6c8c-l4hl9\" (UID: \"7b80f7f0-7211-4304-8c64-fbb1a5981c73\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9" Jul 10 20:25:03.860580 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.860492 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d17091fb-5267-42d2-8683-3b26390a632b-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-6qcbf\" (UID: \"d17091fb-5267-42d2-8683-3b26390a632b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf" Jul 10 20:25:03.869144 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.869094 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26qgj\" (UniqueName: \"kubernetes.io/projected/15ce9a8c-4876-4789-9295-3cd290696c7e-kube-api-access-26qgj\") pod \"cluster-samples-operator-65db858894-dljgc\" (UID: \"15ce9a8c-4876-4789-9295-3cd290696c7e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc" Jul 10 20:25:03.869281 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.869223 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl5lj\" (UniqueName: \"kubernetes.io/projected/d17091fb-5267-42d2-8683-3b26390a632b-kube-api-access-xl5lj\") pod \"kube-storage-version-migrator-operator-799cb7f958-6qcbf\" (UID: \"d17091fb-5267-42d2-8683-3b26390a632b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf" Jul 10 20:25:03.869694 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.869675 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qwbh\" (UniqueName: \"kubernetes.io/projected/7b80f7f0-7211-4304-8c64-fbb1a5981c73-kube-api-access-5qwbh\") pod \"service-ca-operator-7695fc6c8c-l4hl9\" (UID: \"7b80f7f0-7211-4304-8c64-fbb1a5981c73\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9" Jul 10 20:25:03.869919 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.869899 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gh4q\" (UniqueName: \"kubernetes.io/projected/9792b3e3-4f2d-47fc-bd39-7678a663e757-kube-api-access-7gh4q\") pod \"cluster-monitoring-operator-5f7f494dd4-jsrqs\" (UID: \"9792b3e3-4f2d-47fc-bd39-7678a663e757\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" Jul 10 20:25:03.884912 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.884876 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jxkh6" Jul 10 20:25:03.990643 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.990615 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9" Jul 10 20:25:03.996829 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:03.996801 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf" Jul 10 20:25:04.005570 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:04.005546 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jxkh6"] Jul 10 20:25:04.008681 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:25:04.008653 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87628fa9_06d0_42ae_a3aa_f5e2d2eedb83.slice/crio-7c0469b9f08becd050067d6e5d499f8da9fdca1b64e5c844cc3ca98617ea3f2a WatchSource:0}: Error finding container 7c0469b9f08becd050067d6e5d499f8da9fdca1b64e5c844cc3ca98617ea3f2a: Status 404 returned error can't find the container with id 7c0469b9f08becd050067d6e5d499f8da9fdca1b64e5c844cc3ca98617ea3f2a Jul 10 20:25:04.120401 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:04.120272 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9"] Jul 10 20:25:04.123912 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:25:04.123881 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b80f7f0_7211_4304_8c64_fbb1a5981c73.slice/crio-9a7bc99ad6421580223f0dcc14be85012830099f38efbd9191ab2f5f7ef62d06 WatchSource:0}: Error finding container 9a7bc99ad6421580223f0dcc14be85012830099f38efbd9191ab2f5f7ef62d06: Status 404 returned error can't find the container with id 9a7bc99ad6421580223f0dcc14be85012830099f38efbd9191ab2f5f7ef62d06 Jul 10 20:25:04.137299 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:04.137260 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf"] Jul 10 20:25:04.141289 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:25:04.141267 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd17091fb_5267_42d2_8683_3b26390a632b.slice/crio-631f0db7308563f2c9b7bfd6a38c45a978364e65b625d7c1d8714756cda7860d WatchSource:0}: Error finding container 631f0db7308563f2c9b7bfd6a38c45a978364e65b625d7c1d8714756cda7860d: Status 404 returned error can't find the container with id 631f0db7308563f2c9b7bfd6a38c45a978364e65b625d7c1d8714756cda7860d Jul 10 20:25:04.261052 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:04.261009 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:04.261240 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:04.261187 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 20:25:04.261240 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:04.261211 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b9d75b5b-wfpbd: secret "image-registry-tls" not found Jul 10 20:25:04.261307 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:04.261265 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls podName:5fea9949-e4ff-45fc-982a-c634a1d9b074 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:05.261250776 +0000 UTC m=+226.721455580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls") pod "image-registry-78b9d75b5b-wfpbd" (UID: "5fea9949-e4ff-45fc-982a-c634a1d9b074") : secret "image-registry-tls" not found Jul 10 20:25:04.293789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:04.293747 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jxkh6" event={"ID":"87628fa9-06d0-42ae-a3aa-f5e2d2eedb83","Type":"ContainerStarted","Data":"7c0469b9f08becd050067d6e5d499f8da9fdca1b64e5c844cc3ca98617ea3f2a"} Jul 10 20:25:04.294736 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:04.294712 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf" event={"ID":"d17091fb-5267-42d2-8683-3b26390a632b","Type":"ContainerStarted","Data":"631f0db7308563f2c9b7bfd6a38c45a978364e65b625d7c1d8714756cda7860d"} Jul 10 20:25:04.295696 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:04.295676 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9" event={"ID":"7b80f7f0-7211-4304-8c64-fbb1a5981c73","Type":"ContainerStarted","Data":"9a7bc99ad6421580223f0dcc14be85012830099f38efbd9191ab2f5f7ef62d06"} Jul 10 20:25:04.361680 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:04.361645 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dljgc\" (UID: \"15ce9a8c-4876-4789-9295-3cd290696c7e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc" Jul 10 20:25:04.361832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:04.361690 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jsrqs\" (UID: \"9792b3e3-4f2d-47fc-bd39-7678a663e757\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" Jul 10 20:25:04.361832 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:04.361780 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 20:25:04.361832 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:04.361807 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 20:25:04.361968 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:04.361840 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls podName:9792b3e3-4f2d-47fc-bd39-7678a663e757 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:05.361826621 +0000 UTC m=+226.822031425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jsrqs" (UID: "9792b3e3-4f2d-47fc-bd39-7678a663e757") : secret "cluster-monitoring-operator-tls" not found Jul 10 20:25:04.361968 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:04.361878 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls podName:15ce9a8c-4876-4789-9295-3cd290696c7e nodeName:}" failed. No retries permitted until 2026-07-10 20:25:05.36185603 +0000 UTC m=+226.822060835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls") pod "cluster-samples-operator-65db858894-dljgc" (UID: "15ce9a8c-4876-4789-9295-3cd290696c7e") : secret "samples-operator-tls" not found Jul 10 20:25:05.269236 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:05.269185 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:05.269706 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:05.269383 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 20:25:05.269706 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:05.269406 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b9d75b5b-wfpbd: secret "image-registry-tls" not found Jul 10 20:25:05.269706 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:05.269474 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls podName:5fea9949-e4ff-45fc-982a-c634a1d9b074 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:07.269452606 +0000 UTC m=+228.729657412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls") pod "image-registry-78b9d75b5b-wfpbd" (UID: "5fea9949-e4ff-45fc-982a-c634a1d9b074") : secret "image-registry-tls" not found Jul 10 20:25:05.370625 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:05.370581 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dljgc\" (UID: \"15ce9a8c-4876-4789-9295-3cd290696c7e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc" Jul 10 20:25:05.370768 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:05.370644 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jsrqs\" (UID: \"9792b3e3-4f2d-47fc-bd39-7678a663e757\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" Jul 10 20:25:05.370823 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:05.370779 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 20:25:05.370823 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:05.370807 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 20:25:05.370918 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:05.370862 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls podName:15ce9a8c-4876-4789-9295-3cd290696c7e nodeName:}" failed. No retries permitted until 2026-07-10 20:25:07.370837212 +0000 UTC m=+228.831042039 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls") pod "cluster-samples-operator-65db858894-dljgc" (UID: "15ce9a8c-4876-4789-9295-3cd290696c7e") : secret "samples-operator-tls" not found Jul 10 20:25:05.370918 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:05.370883 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls podName:9792b3e3-4f2d-47fc-bd39-7678a663e757 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:07.370872685 +0000 UTC m=+228.831077493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jsrqs" (UID: "9792b3e3-4f2d-47fc-bd39-7678a663e757") : secret "cluster-monitoring-operator-tls" not found Jul 10 20:25:06.303707 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:06.303666 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jxkh6" event={"ID":"87628fa9-06d0-42ae-a3aa-f5e2d2eedb83","Type":"ContainerStarted","Data":"e5f74e93c5e39760114979d88e412268bd0918e2f903f2845e0c3a4ec507c2b9"} Jul 10 20:25:06.320452 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:06.320390 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-jxkh6" podStartSLOduration=2.000513307 podStartE2EDuration="3.320374239s" totalImagesPullingTime="1.319860932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:06.319025938 +0000 UTC m=+227.779230765" watchObservedRunningTime="2026-07-10 20:25:06.320374239 +0000 UTC m=+227.780579064" Jul 10 20:25:07.285571 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.285471 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:07.285736 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:07.285589 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 20:25:07.285736 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:07.285601 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b9d75b5b-wfpbd: secret "image-registry-tls" not found Jul 10 20:25:07.285736 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:07.285650 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls podName:5fea9949-e4ff-45fc-982a-c634a1d9b074 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:11.285637095 +0000 UTC m=+232.745841900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls") pod "image-registry-78b9d75b5b-wfpbd" (UID: "5fea9949-e4ff-45fc-982a-c634a1d9b074") : secret "image-registry-tls" not found Jul 10 20:25:07.308483 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.308445 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf" event={"ID":"d17091fb-5267-42d2-8683-3b26390a632b","Type":"ContainerStarted","Data":"bf06652e1b6d30b2488bfa980664b89783c36aecfb8d9d67127f411d9d01fb24"} Jul 10 20:25:07.309876 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.309848 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9" event={"ID":"7b80f7f0-7211-4304-8c64-fbb1a5981c73","Type":"ContainerStarted","Data":"8c8736b239a258ff61e961803b85ac249b6441dc2a0e3b7c00a6ef37518bd420"} Jul 10 20:25:07.323076 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.323011 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf" podStartSLOduration=1.939710788 podStartE2EDuration="4.322994392s" totalImagesPullingTime="2.383283604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:07.322991995 +0000 UTC m=+228.783196822" watchObservedRunningTime="2026-07-10 20:25:07.322994392 +0000 UTC m=+228.783199218" Jul 10 20:25:07.336902 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.336842 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9" podStartSLOduration=1.415117401 podStartE2EDuration="4.336825627s" totalImagesPullingTime="2.921708226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:07.33675724 +0000 UTC m=+228.796962069" watchObservedRunningTime="2026-07-10 20:25:07.336825627 +0000 UTC m=+228.797030454" Jul 10 20:25:07.386982 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.386446 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dljgc\" (UID: \"15ce9a8c-4876-4789-9295-3cd290696c7e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc" Jul 10 20:25:07.386982 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.386527 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jsrqs\" (UID: \"9792b3e3-4f2d-47fc-bd39-7678a663e757\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" Jul 10 20:25:07.386982 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:07.386934 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 20:25:07.387275 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:07.387000 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls podName:15ce9a8c-4876-4789-9295-3cd290696c7e nodeName:}" failed. No retries permitted until 2026-07-10 20:25:11.386976958 +0000 UTC m=+232.847181766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls") pod "cluster-samples-operator-65db858894-dljgc" (UID: "15ce9a8c-4876-4789-9295-3cd290696c7e") : secret "samples-operator-tls" not found Jul 10 20:25:07.387275 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:07.386935 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 20:25:07.387275 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:07.387081 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls podName:9792b3e3-4f2d-47fc-bd39-7678a663e757 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:11.387061828 +0000 UTC m=+232.847266636 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jsrqs" (UID: "9792b3e3-4f2d-47fc-bd39-7678a663e757") : secret "cluster-monitoring-operator-tls" not found Jul 10 20:25:07.466907 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.466869 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-flfd4"] Jul 10 20:25:07.469564 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.469541 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:07.472731 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.472650 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 20:25:07.472866 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.472781 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 20:25:07.472866 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.472795 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 20:25:07.473083 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.473067 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 20:25:07.473231 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.473215 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mrs5z\"" Jul 10 20:25:07.489927 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.489892 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-flfd4"] Jul 10 20:25:07.587420 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.587325 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a68b4c6-47ad-4089-a652-3420f5f7d02d-crio-socket\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:07.587420 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.587378 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scc4k\" (UniqueName: \"kubernetes.io/projected/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-api-access-scc4k\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:07.587420 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.587402 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:07.587672 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.587473 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a68b4c6-47ad-4089-a652-3420f5f7d02d-data-volume\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:07.587672 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.587537 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:07.688922 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.688874 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a68b4c6-47ad-4089-a652-3420f5f7d02d-crio-socket\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:07.689123 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.688941 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scc4k\" (UniqueName: \"kubernetes.io/projected/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-api-access-scc4k\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:07.689123 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.688972 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:07.689123 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.689002 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a68b4c6-47ad-4089-a652-3420f5f7d02d-crio-socket\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:07.689123 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.689009 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a68b4c6-47ad-4089-a652-3420f5f7d02d-data-volume\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:07.689123 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.689081 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:07.689123 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:07.689092 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 20:25:07.689391 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:07.689182 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm podName:9a68b4c6-47ad-4089-a652-3420f5f7d02d nodeName:}" failed. No retries permitted until 2026-07-10 20:25:08.189161203 +0000 UTC m=+229.649366010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-flfd4" (UID: "9a68b4c6-47ad-4089-a652-3420f5f7d02d") : configmap "kube-rbac-proxy" not found Jul 10 20:25:07.689391 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:07.689205 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 20:25:07.689391 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:07.689266 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls podName:9a68b4c6-47ad-4089-a652-3420f5f7d02d nodeName:}" failed. No retries permitted until 2026-07-10 20:25:08.189250832 +0000 UTC m=+229.649455651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-flfd4" (UID: "9a68b4c6-47ad-4089-a652-3420f5f7d02d") : secret "insights-runtime-extractor-tls" not found Jul 10 20:25:07.689486 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.689415 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a68b4c6-47ad-4089-a652-3420f5f7d02d-data-volume\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:07.697772 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:07.697744 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scc4k\" (UniqueName: \"kubernetes.io/projected/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-api-access-scc4k\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:08.192758 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:08.192720 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:08.192907 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:08.192799 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 20:25:08.192907 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:08.192857 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm podName:9a68b4c6-47ad-4089-a652-3420f5f7d02d nodeName:}" failed. No retries permitted until 2026-07-10 20:25:09.192841788 +0000 UTC m=+230.653046593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-flfd4" (UID: "9a68b4c6-47ad-4089-a652-3420f5f7d02d") : configmap "kube-rbac-proxy" not found Jul 10 20:25:08.192907 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:08.192877 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:08.193034 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:08.192952 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 20:25:08.193034 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:08.192975 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls podName:9a68b4c6-47ad-4089-a652-3420f5f7d02d nodeName:}" failed. No retries permitted until 2026-07-10 20:25:09.192966772 +0000 UTC m=+230.653171577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-flfd4" (UID: "9a68b4c6-47ad-4089-a652-3420f5f7d02d") : secret "insights-runtime-extractor-tls" not found Jul 10 20:25:08.199346 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:08.199311 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xkmck"] Jul 10 20:25:08.202650 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:08.202624 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xkmck" Jul 10 20:25:08.204672 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:08.204646 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 10 20:25:08.204806 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:08.204711 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 10 20:25:08.205611 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:08.205594 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5vd8d\"" Jul 10 20:25:08.208051 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:08.208030 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xkmck"] Jul 10 20:25:08.293841 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:08.293796 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65rt8\" (UniqueName: \"kubernetes.io/projected/2857c00b-21d2-44a0-8a84-6c17e2dfba24-kube-api-access-65rt8\") pod \"migrator-7f59b54f6c-xkmck\" (UID: \"2857c00b-21d2-44a0-8a84-6c17e2dfba24\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xkmck" Jul 10 20:25:08.395182 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:08.395117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65rt8\" (UniqueName: \"kubernetes.io/projected/2857c00b-21d2-44a0-8a84-6c17e2dfba24-kube-api-access-65rt8\") pod \"migrator-7f59b54f6c-xkmck\" (UID: \"2857c00b-21d2-44a0-8a84-6c17e2dfba24\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xkmck" Jul 10 20:25:08.402829 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:08.402809 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65rt8\" (UniqueName: \"kubernetes.io/projected/2857c00b-21d2-44a0-8a84-6c17e2dfba24-kube-api-access-65rt8\") pod \"migrator-7f59b54f6c-xkmck\" (UID: \"2857c00b-21d2-44a0-8a84-6c17e2dfba24\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xkmck" Jul 10 20:25:08.512879 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:08.512784 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xkmck" Jul 10 20:25:08.636947 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:08.636919 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xkmck"] Jul 10 20:25:08.639787 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:25:08.639764 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2857c00b_21d2_44a0_8a84_6c17e2dfba24.slice/crio-528f89d17672c8c716ab128df9457f40093d714ef368b4ff97fa0db904008035 WatchSource:0}: Error finding container 528f89d17672c8c716ab128df9457f40093d714ef368b4ff97fa0db904008035: Status 404 returned error can't find the container with id 528f89d17672c8c716ab128df9457f40093d714ef368b4ff97fa0db904008035 Jul 10 20:25:09.201444 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:09.201404 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:09.201694 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:09.201467 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:09.201694 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:09.201533 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 20:25:09.201694 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:09.201555 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 20:25:09.201694 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:09.201596 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls podName:9a68b4c6-47ad-4089-a652-3420f5f7d02d nodeName:}" failed. No retries permitted until 2026-07-10 20:25:11.201582697 +0000 UTC m=+232.661787501 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-flfd4" (UID: "9a68b4c6-47ad-4089-a652-3420f5f7d02d") : secret "insights-runtime-extractor-tls" not found Jul 10 20:25:09.201694 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:09.201609 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm podName:9a68b4c6-47ad-4089-a652-3420f5f7d02d nodeName:}" failed. No retries permitted until 2026-07-10 20:25:11.201602871 +0000 UTC m=+232.661807674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-flfd4" (UID: "9a68b4c6-47ad-4089-a652-3420f5f7d02d") : configmap "kube-rbac-proxy" not found Jul 10 20:25:09.317046 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:09.317010 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xkmck" event={"ID":"2857c00b-21d2-44a0-8a84-6c17e2dfba24","Type":"ContainerStarted","Data":"528f89d17672c8c716ab128df9457f40093d714ef368b4ff97fa0db904008035"} Jul 10 20:25:09.322993 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:09.322972 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dlpg8_8f7b5179-aa27-496e-9181-5c85edf27e29/dns-node-resolver/0.log" Jul 10 20:25:10.722659 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:10.722630 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tq429_e4c479fa-abe8-4123-a651-449f41f51e85/node-ca/0.log" Jul 10 20:25:11.219035 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:11.218994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:11.219233 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:11.219056 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:11.219233 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:11.219125 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 20:25:11.219233 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:11.219167 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 20:25:11.219233 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:11.219210 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls podName:9a68b4c6-47ad-4089-a652-3420f5f7d02d nodeName:}" failed. No retries permitted until 2026-07-10 20:25:15.219195311 +0000 UTC m=+236.679400114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-flfd4" (UID: "9a68b4c6-47ad-4089-a652-3420f5f7d02d") : secret "insights-runtime-extractor-tls" not found Jul 10 20:25:11.219233 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:11.219222 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm podName:9a68b4c6-47ad-4089-a652-3420f5f7d02d nodeName:}" failed. No retries permitted until 2026-07-10 20:25:15.219216405 +0000 UTC m=+236.679421209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-flfd4" (UID: "9a68b4c6-47ad-4089-a652-3420f5f7d02d") : configmap "kube-rbac-proxy" not found Jul 10 20:25:11.319925 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:11.319886 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:11.320096 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:11.320054 2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 20:25:11.320096 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:11.320075 2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78b9d75b5b-wfpbd: secret "image-registry-tls" not found Jul 10 20:25:11.320199 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:11.320124 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls podName:5fea9949-e4ff-45fc-982a-c634a1d9b074 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:19.320110549 +0000 UTC m=+240.780315353 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls") pod "image-registry-78b9d75b5b-wfpbd" (UID: "5fea9949-e4ff-45fc-982a-c634a1d9b074") : secret "image-registry-tls" not found Jul 10 20:25:11.326798 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:11.324685 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xkmck" event={"ID":"2857c00b-21d2-44a0-8a84-6c17e2dfba24","Type":"ContainerStarted","Data":"6f48c35a69dab135c1149ffb34044fecc95f5e6d71a3d5a19381d052f6dccf83"} Jul 10 20:25:11.326798 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:11.324792 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xkmck" event={"ID":"2857c00b-21d2-44a0-8a84-6c17e2dfba24","Type":"ContainerStarted","Data":"108f6444d34de27b59ce9ffc2710881fb950c0db4af4c5aedf1f40fcf9cff16f"} Jul 10 20:25:11.341528 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:11.341480 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-xkmck" podStartSLOduration=1.686786599 podStartE2EDuration="3.3414624s" totalImagesPullingTime="1.654675801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:11.341193207 +0000 UTC m=+232.801398033" watchObservedRunningTime="2026-07-10 20:25:11.3414624 +0000 UTC m=+232.801667226" Jul 10 20:25:11.420998 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:11.420946 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dljgc\" (UID: \"15ce9a8c-4876-4789-9295-3cd290696c7e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc" Jul 10 20:25:11.421209 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:11.421087 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jsrqs\" (UID: \"9792b3e3-4f2d-47fc-bd39-7678a663e757\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" Jul 10 20:25:11.421209 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:11.421161 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 20:25:11.421209 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:11.421205 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 20:25:11.421325 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:11.421230 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls podName:15ce9a8c-4876-4789-9295-3cd290696c7e nodeName:}" failed. No retries permitted until 2026-07-10 20:25:19.421214756 +0000 UTC m=+240.881419561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls") pod "cluster-samples-operator-65db858894-dljgc" (UID: "15ce9a8c-4876-4789-9295-3cd290696c7e") : secret "samples-operator-tls" not found Jul 10 20:25:11.421325 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:11.421256 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls podName:9792b3e3-4f2d-47fc-bd39-7678a663e757 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:19.421244543 +0000 UTC m=+240.881449348 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jsrqs" (UID: "9792b3e3-4f2d-47fc-bd39-7678a663e757") : secret "cluster-monitoring-operator-tls" not found Jul 10 20:25:11.525506 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:11.525432 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-scdn6_f14f7f56-76e3-419f-8465-2f708f109e31/serve-healthcheck-canary/0.log" Jul 10 20:25:15.252363 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:15.252321 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:15.252741 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:15.252419 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:15.252741 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:15.252482 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 20:25:15.252741 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:15.252497 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 20:25:15.252741 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:15.252545 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls podName:9a68b4c6-47ad-4089-a652-3420f5f7d02d nodeName:}" failed. No retries permitted until 2026-07-10 20:25:23.252530378 +0000 UTC m=+244.712735182 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-flfd4" (UID: "9a68b4c6-47ad-4089-a652-3420f5f7d02d") : secret "insights-runtime-extractor-tls" not found Jul 10 20:25:15.252741 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:15.252563 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm podName:9a68b4c6-47ad-4089-a652-3420f5f7d02d nodeName:}" failed. No retries permitted until 2026-07-10 20:25:23.25255498 +0000 UTC m=+244.712759783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-flfd4" (UID: "9a68b4c6-47ad-4089-a652-3420f5f7d02d") : configmap "kube-rbac-proxy" not found Jul 10 20:25:19.387796 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:19.387744 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:19.390245 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:19.390225 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls\") pod \"image-registry-78b9d75b5b-wfpbd\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:19.488111 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:19.488077 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dljgc\" (UID: \"15ce9a8c-4876-4789-9295-3cd290696c7e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc" Jul 10 20:25:19.488277 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:19.488160 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jsrqs\" (UID: \"9792b3e3-4f2d-47fc-bd39-7678a663e757\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" Jul 10 20:25:19.488277 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:19.488246 2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 20:25:19.488354 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:19.488302 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls podName:9792b3e3-4f2d-47fc-bd39-7678a663e757 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:35.488290083 +0000 UTC m=+256.948494886 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-jsrqs" (UID: "9792b3e3-4f2d-47fc-bd39-7678a663e757") : secret "cluster-monitoring-operator-tls" not found Jul 10 20:25:19.490624 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:19.490598 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/15ce9a8c-4876-4789-9295-3cd290696c7e-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-dljgc\" (UID: \"15ce9a8c-4876-4789-9295-3cd290696c7e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc" Jul 10 20:25:19.491632 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:19.491615 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s5ppj\"" Jul 10 20:25:19.500423 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:19.500405 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:19.585745 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:19.585718 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-m6gjf\"" Jul 10 20:25:19.594440 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:19.594414 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc" Jul 10 20:25:19.629062 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:19.629033 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78b9d75b5b-wfpbd"] Jul 10 20:25:19.632813 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:25:19.632789 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fea9949_e4ff_45fc_982a_c634a1d9b074.slice/crio-ef8797074303650128ea01098dd28482321f62f6b5d02561ff163fd35b1fb797 WatchSource:0}: Error finding container ef8797074303650128ea01098dd28482321f62f6b5d02561ff163fd35b1fb797: Status 404 returned error can't find the container with id ef8797074303650128ea01098dd28482321f62f6b5d02561ff163fd35b1fb797 Jul 10 20:25:19.719590 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:19.719558 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc"] Jul 10 20:25:20.352429 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:20.352392 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" event={"ID":"5fea9949-e4ff-45fc-982a-c634a1d9b074","Type":"ContainerStarted","Data":"7b229dde1e0fbc28d4659c98b484367e8608b079f2fc3c48dbf43192c85e68a5"} Jul 10 20:25:20.352618 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:20.352441 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" event={"ID":"5fea9949-e4ff-45fc-982a-c634a1d9b074","Type":"ContainerStarted","Data":"ef8797074303650128ea01098dd28482321f62f6b5d02561ff163fd35b1fb797"} Jul 10 20:25:20.352618 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:20.352469 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:20.353555 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:20.353527 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc" event={"ID":"15ce9a8c-4876-4789-9295-3cd290696c7e","Type":"ContainerStarted","Data":"067ddb7697e52c115433edfee7637df084c1f4d0105d67a638111b5100ce9d80"} Jul 10 20:25:20.370287 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:20.370248 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" podStartSLOduration=17.370235554 podStartE2EDuration="17.370235554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:20.369343356 +0000 UTC m=+241.829548184" watchObservedRunningTime="2026-07-10 20:25:20.370235554 +0000 UTC m=+241.830440422" Jul 10 20:25:22.361073 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:22.361034 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc" event={"ID":"15ce9a8c-4876-4789-9295-3cd290696c7e","Type":"ContainerStarted","Data":"89fef20be23440b6e0fab7e8c36b7b98aad703cb92b97cbdd89242f419925a29"} Jul 10 20:25:22.361462 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:22.361093 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc" event={"ID":"15ce9a8c-4876-4789-9295-3cd290696c7e","Type":"ContainerStarted","Data":"81f914db2db816d2fb533e46d2381a968076f30910a0cf9e14ed1eb70ae3a9a1"} Jul 10 20:25:22.377778 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:22.377721 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-dljgc" podStartSLOduration=17.613024304 podStartE2EDuration="19.377705422s" totalImagesPullingTime="1.764681118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:22.376695248 +0000 UTC m=+243.836900122" watchObservedRunningTime="2026-07-10 20:25:22.377705422 +0000 UTC m=+243.837910248" Jul 10 20:25:23.318039 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:23.317984 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:23.318259 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:23.318078 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:23.318259 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:23.318154 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 20:25:23.318259 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:23.318217 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls podName:9a68b4c6-47ad-4089-a652-3420f5f7d02d nodeName:}" failed. No retries permitted until 2026-07-10 20:25:39.31820211 +0000 UTC m=+260.778406917 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-flfd4" (UID: "9a68b4c6-47ad-4089-a652-3420f5f7d02d") : secret "insights-runtime-extractor-tls" not found Jul 10 20:25:23.318565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:23.318550 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a68b4c6-47ad-4089-a652-3420f5f7d02d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:29.926631 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:29.926587 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78b9d75b5b-wfpbd"] Jul 10 20:25:29.948784 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:29.948754 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-p8f9b"] Jul 10 20:25:29.953242 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:29.953221 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-p8f9b" Jul 10 20:25:29.955992 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:29.955958 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 20:25:29.955992 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:29.955984 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 20:25:29.956243 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:29.956103 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-sr5qb\"" Jul 10 20:25:29.963173 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:29.963153 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-p8f9b"] Jul 10 20:25:30.070753 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:30.070725 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m959z\" (UniqueName: \"kubernetes.io/projected/177c3bf7-25be-4820-b836-44b4c969b0e1-kube-api-access-m959z\") pod \"downloads-68c9cbb497-p8f9b\" (UID: \"177c3bf7-25be-4820-b836-44b4c969b0e1\") " pod="openshift-console/downloads-68c9cbb497-p8f9b" Jul 10 20:25:30.171979 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:30.171942 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m959z\" (UniqueName: \"kubernetes.io/projected/177c3bf7-25be-4820-b836-44b4c969b0e1-kube-api-access-m959z\") pod \"downloads-68c9cbb497-p8f9b\" (UID: \"177c3bf7-25be-4820-b836-44b4c969b0e1\") " pod="openshift-console/downloads-68c9cbb497-p8f9b" Jul 10 20:25:30.180406 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:30.180343 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m959z\" (UniqueName: \"kubernetes.io/projected/177c3bf7-25be-4820-b836-44b4c969b0e1-kube-api-access-m959z\") pod \"downloads-68c9cbb497-p8f9b\" (UID: \"177c3bf7-25be-4820-b836-44b4c969b0e1\") " pod="openshift-console/downloads-68c9cbb497-p8f9b" Jul 10 20:25:30.264164 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:30.264119 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-p8f9b" Jul 10 20:25:30.387898 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:30.387870 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-p8f9b"] Jul 10 20:25:30.391450 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:25:30.391425 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod177c3bf7_25be_4820_b836_44b4c969b0e1.slice/crio-fcf34fa33dfde974aa3973f67469e1d8a8b4ccfeceee63f1f2ac72dfea85c20f WatchSource:0}: Error finding container fcf34fa33dfde974aa3973f67469e1d8a8b4ccfeceee63f1f2ac72dfea85c20f: Status 404 returned error can't find the container with id fcf34fa33dfde974aa3973f67469e1d8a8b4ccfeceee63f1f2ac72dfea85c20f Jul 10 20:25:31.390026 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:31.389992 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-p8f9b" event={"ID":"177c3bf7-25be-4820-b836-44b4c969b0e1","Type":"ContainerStarted","Data":"fcf34fa33dfde974aa3973f67469e1d8a8b4ccfeceee63f1f2ac72dfea85c20f"} Jul 10 20:25:31.484070 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:31.484020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs\") pod \"network-metrics-daemon-gsjgb\" (UID: \"1d2a9a56-7498-4287-92d4-d6805d7fefa4\") " pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:25:31.486680 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:31.486654 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d2a9a56-7498-4287-92d4-d6805d7fefa4-metrics-certs\") pod \"network-metrics-daemon-gsjgb\" (UID: \"1d2a9a56-7498-4287-92d4-d6805d7fefa4\") " pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:25:31.657420 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:31.657342 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mr56z\"" Jul 10 20:25:31.665655 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:31.665630 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gsjgb" Jul 10 20:25:31.808050 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:31.808018 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gsjgb"] Jul 10 20:25:31.811650 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:25:31.811621 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2a9a56_7498_4287_92d4_d6805d7fefa4.slice/crio-9a4418f57bb550fda2f8d15ff1c9a8ade74b02f8167e317ad16226dc42593cdf WatchSource:0}: Error finding container 9a4418f57bb550fda2f8d15ff1c9a8ade74b02f8167e317ad16226dc42593cdf: Status 404 returned error can't find the container with id 9a4418f57bb550fda2f8d15ff1c9a8ade74b02f8167e317ad16226dc42593cdf Jul 10 20:25:32.395994 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:32.395956 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gsjgb" event={"ID":"1d2a9a56-7498-4287-92d4-d6805d7fefa4","Type":"ContainerStarted","Data":"9a4418f57bb550fda2f8d15ff1c9a8ade74b02f8167e317ad16226dc42593cdf"} Jul 10 20:25:33.401445 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:33.401412 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gsjgb" event={"ID":"1d2a9a56-7498-4287-92d4-d6805d7fefa4","Type":"ContainerStarted","Data":"26baaa6d1979c533f36e2c34f305acce6d80fa9937c6392a4edae75a68b280f3"} Jul 10 20:25:33.401907 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:33.401463 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gsjgb" event={"ID":"1d2a9a56-7498-4287-92d4-d6805d7fefa4","Type":"ContainerStarted","Data":"456f5c3c7468445ebfe03c33651fb8ff8d1135d75f7378ed4a4634d54682ee2e"} Jul 10 20:25:33.416697 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:33.416649 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gsjgb" podStartSLOduration=253.360419053 podStartE2EDuration="4m14.416628366s" totalImagesPullingTime="1.056209313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:33.416465453 +0000 UTC m=+254.876670282" watchObservedRunningTime="2026-07-10 20:25:33.416628366 +0000 UTC m=+254.876833194" Jul 10 20:25:35.519052 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:35.518999 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jsrqs\" (UID: \"9792b3e3-4f2d-47fc-bd39-7678a663e757\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" Jul 10 20:25:35.521867 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:35.521836 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9792b3e3-4f2d-47fc-bd39-7678a663e757-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-jsrqs\" (UID: \"9792b3e3-4f2d-47fc-bd39-7678a663e757\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" Jul 10 20:25:35.804615 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:35.804539 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-m5blc\"" Jul 10 20:25:35.813450 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:35.813423 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" Jul 10 20:25:35.990951 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:35.990923 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs"] Jul 10 20:25:35.994779 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:25:35.994739 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9792b3e3_4f2d_47fc_bd39_7678a663e757.slice/crio-7cea128f7be2fab777ceeea9e769955ff0a4a426daf65854417f74223004ea81 WatchSource:0}: Error finding container 7cea128f7be2fab777ceeea9e769955ff0a4a426daf65854417f74223004ea81: Status 404 returned error can't find the container with id 7cea128f7be2fab777ceeea9e769955ff0a4a426daf65854417f74223004ea81 Jul 10 20:25:36.411776 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:36.411740 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" event={"ID":"9792b3e3-4f2d-47fc-bd39-7678a663e757","Type":"ContainerStarted","Data":"7cea128f7be2fab777ceeea9e769955ff0a4a426daf65854417f74223004ea81"} Jul 10 20:25:39.351306 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:39.351268 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:39.354235 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:39.354202 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a68b4c6-47ad-4089-a652-3420f5f7d02d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flfd4\" (UID: \"9a68b4c6-47ad-4089-a652-3420f5f7d02d\") " pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:39.581279 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:39.581246 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mrs5z\"" Jul 10 20:25:39.589051 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:39.589015 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-flfd4" Jul 10 20:25:39.744523 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:39.744487 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-flfd4"] Jul 10 20:25:39.747944 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:25:39.747915 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a68b4c6_47ad_4089_a652_3420f5f7d02d.slice/crio-37373d235de2e007126e18615737df9cb219ba45bbbb86b85ba6a0c20e371a23 WatchSource:0}: Error finding container 37373d235de2e007126e18615737df9cb219ba45bbbb86b85ba6a0c20e371a23: Status 404 returned error can't find the container with id 37373d235de2e007126e18615737df9cb219ba45bbbb86b85ba6a0c20e371a23 Jul 10 20:25:39.933426 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:39.933334 2580 patch_prober.go:28] interesting pod/image-registry-78b9d75b5b-wfpbd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 20:25:39.933426 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:39.933389 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" podUID="5fea9949-e4ff-45fc-982a-c634a1d9b074" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 20:25:39.999918 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:39.999881 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-86lbg"] Jul 10 20:25:40.002250 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:40.002232 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-86lbg" Jul 10 20:25:40.004493 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:40.004449 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 10 20:25:40.004617 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:40.004519 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qhzxj\"" Jul 10 20:25:40.010192 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:40.009891 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-86lbg"] Jul 10 20:25:40.057937 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:40.057895 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cf57315e-650b-46a7-8d5d-da94f6bf6c95-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-86lbg\" (UID: \"cf57315e-650b-46a7-8d5d-da94f6bf6c95\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-86lbg" Jul 10 20:25:40.159196 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:40.159111 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cf57315e-650b-46a7-8d5d-da94f6bf6c95-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-86lbg\" (UID: \"cf57315e-650b-46a7-8d5d-da94f6bf6c95\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-86lbg" Jul 10 20:25:40.161924 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:40.161893 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cf57315e-650b-46a7-8d5d-da94f6bf6c95-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-86lbg\" (UID: \"cf57315e-650b-46a7-8d5d-da94f6bf6c95\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-86lbg" Jul 10 20:25:40.313711 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:40.313626 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-86lbg" Jul 10 20:25:40.441651 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:40.441520 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flfd4" event={"ID":"9a68b4c6-47ad-4089-a652-3420f5f7d02d","Type":"ContainerStarted","Data":"37373d235de2e007126e18615737df9cb219ba45bbbb86b85ba6a0c20e371a23"} Jul 10 20:25:40.445040 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:40.444861 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" event={"ID":"9792b3e3-4f2d-47fc-bd39-7678a663e757","Type":"ContainerStarted","Data":"891d3d34b47a6db85e51dd66fd76df5170c0ed66f9641194baf6d221451e8669"} Jul 10 20:25:40.488978 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:40.488909 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-jsrqs" podStartSLOduration=33.98778523 podStartE2EDuration="37.48879203s" totalImagesPullingTime="3.5010068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:40.463815842 +0000 UTC m=+261.924020669" watchObservedRunningTime="2026-07-10 20:25:40.48879203 +0000 UTC m=+261.948996850" Jul 10 20:25:40.491061 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:40.491030 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-86lbg"] Jul 10 20:25:40.495076 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:25:40.495028 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf57315e_650b_46a7_8d5d_da94f6bf6c95.slice/crio-081909fdb09cf9616f920d7b268f10f753d3456402ed4f993b28af3cdc3a9867 WatchSource:0}: Error finding container 081909fdb09cf9616f920d7b268f10f753d3456402ed4f993b28af3cdc3a9867: Status 404 returned error can't find the container with id 081909fdb09cf9616f920d7b268f10f753d3456402ed4f993b28af3cdc3a9867 Jul 10 20:25:41.451993 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:41.451914 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-86lbg" event={"ID":"cf57315e-650b-46a7-8d5d-da94f6bf6c95","Type":"ContainerStarted","Data":"081909fdb09cf9616f920d7b268f10f753d3456402ed4f993b28af3cdc3a9867"} Jul 10 20:25:44.267302 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.267265 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bfd85ddcf-n4j4t"] Jul 10 20:25:44.269763 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.269737 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.272232 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.272211 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 20:25:44.272350 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.272235 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 20:25:44.273294 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.273188 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 20:25:44.273294 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.273205 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 20:25:44.273294 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.273251 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wfkq5\"" Jul 10 20:25:44.273480 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.273321 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 20:25:44.280980 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.280958 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bfd85ddcf-n4j4t"] Jul 10 20:25:44.296686 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.296654 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-service-ca\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.296841 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.296695 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl8x4\" (UniqueName: \"kubernetes.io/projected/0220e322-a34e-4f38-9e3e-6112244d995f-kube-api-access-vl8x4\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.296841 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.296723 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0220e322-a34e-4f38-9e3e-6112244d995f-console-oauth-config\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.296841 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.296750 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-oauth-serving-cert\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.296841 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.296829 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-console-config\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.297040 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.296882 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0220e322-a34e-4f38-9e3e-6112244d995f-console-serving-cert\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.398253 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.398218 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-service-ca\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.398434 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.398261 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl8x4\" (UniqueName: \"kubernetes.io/projected/0220e322-a34e-4f38-9e3e-6112244d995f-kube-api-access-vl8x4\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.398434 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.398398 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0220e322-a34e-4f38-9e3e-6112244d995f-console-oauth-config\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.398530 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.398466 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-oauth-serving-cert\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.398581 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.398511 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-console-config\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.398581 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.398572 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0220e322-a34e-4f38-9e3e-6112244d995f-console-serving-cert\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.399080 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.399047 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-service-ca\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.399221 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.399207 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-oauth-serving-cert\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.399292 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.399275 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-console-config\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.401082 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.401061 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0220e322-a34e-4f38-9e3e-6112244d995f-console-oauth-config\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.401233 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.401212 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0220e322-a34e-4f38-9e3e-6112244d995f-console-serving-cert\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.408960 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.408936 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl8x4\" (UniqueName: \"kubernetes.io/projected/0220e322-a34e-4f38-9e3e-6112244d995f-kube-api-access-vl8x4\") pod \"console-6bfd85ddcf-n4j4t\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:44.581202 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:44.581116 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:25:49.865263 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:49.865185 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6765b947fd-kmjq6"] Jul 10 20:25:49.872034 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:49.872009 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:49.885444 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:49.885414 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6765b947fd-kmjq6"] Jul 10 20:25:49.887401 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:49.887335 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 10 20:25:49.932091 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:49.932059 2580 patch_prober.go:28] interesting pod/image-registry-78b9d75b5b-wfpbd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 20:25:49.932280 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:49.932146 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" podUID="5fea9949-e4ff-45fc-982a-c634a1d9b074" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 20:25:49.942732 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:49.942704 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/753a981b-f047-46c5-b034-10145ec7e361-console-serving-cert\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:49.942732 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:49.942739 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-service-ca\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:49.942931 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:49.942767 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-oauth-serving-cert\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:49.942931 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:49.942869 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-console-config\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:49.942931 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:49.942906 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/753a981b-f047-46c5-b034-10145ec7e361-console-oauth-config\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:49.943088 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:49.942933 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-trusted-ca-bundle\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:49.943088 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:49.943023 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqbcp\" (UniqueName: \"kubernetes.io/projected/753a981b-f047-46c5-b034-10145ec7e361-kube-api-access-zqbcp\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:50.044009 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:50.043964 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/753a981b-f047-46c5-b034-10145ec7e361-console-serving-cert\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:50.044217 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:50.044021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-service-ca\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:50.044217 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:50.044147 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-oauth-serving-cert\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:50.044359 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:50.044243 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-console-config\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:50.044359 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:50.044272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/753a981b-f047-46c5-b034-10145ec7e361-console-oauth-config\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:50.044359 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:50.044300 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-trusted-ca-bundle\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:50.044499 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:50.044369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqbcp\" (UniqueName: \"kubernetes.io/projected/753a981b-f047-46c5-b034-10145ec7e361-kube-api-access-zqbcp\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:50.044846 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:50.044818 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-service-ca\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:50.044958 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:50.044828 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-oauth-serving-cert\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:50.044958 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:50.044941 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-console-config\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:50.045472 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:50.045454 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-trusted-ca-bundle\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:50.047006 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:50.046984 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/753a981b-f047-46c5-b034-10145ec7e361-console-oauth-config\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:50.047202 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:50.047182 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/753a981b-f047-46c5-b034-10145ec7e361-console-serving-cert\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:50.051981 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:50.051962 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqbcp\" (UniqueName: \"kubernetes.io/projected/753a981b-f047-46c5-b034-10145ec7e361-kube-api-access-zqbcp\") pod \"console-6765b947fd-kmjq6\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:50.190548 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:50.190512 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:25:50.295274 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:50.295240 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bfd85ddcf-n4j4t"] Jul 10 20:25:50.510889 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:25:50.510861 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0220e322_a34e_4f38_9e3e_6112244d995f.slice/crio-8b825bcfcca32e72e85bec2888d826af320cce8b71a215127bf414c94a10efdc WatchSource:0}: Error finding container 8b825bcfcca32e72e85bec2888d826af320cce8b71a215127bf414c94a10efdc: Status 404 returned error can't find the container with id 8b825bcfcca32e72e85bec2888d826af320cce8b71a215127bf414c94a10efdc Jul 10 20:25:50.656050 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:50.656018 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6765b947fd-kmjq6"] Jul 10 20:25:50.660743 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:25:50.660709 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod753a981b_f047_46c5_b034_10145ec7e361.slice/crio-24597e506f88ae4c6561b14f38462b2050570a42a5d06c33edb871b6b19571ad WatchSource:0}: Error finding container 24597e506f88ae4c6561b14f38462b2050570a42a5d06c33edb871b6b19571ad: Status 404 returned error can't find the container with id 24597e506f88ae4c6561b14f38462b2050570a42a5d06c33edb871b6b19571ad Jul 10 20:25:51.493398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:51.493357 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-p8f9b" event={"ID":"177c3bf7-25be-4820-b836-44b4c969b0e1","Type":"ContainerStarted","Data":"b8ce92c75ab538d2f85dffd5b20c78f2b4db07201f5b7b0dde1d9e729de12317"} Jul 10 20:25:51.494355 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:51.494332 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-p8f9b" Jul 10 20:25:51.496625 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:51.496599 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flfd4" event={"ID":"9a68b4c6-47ad-4089-a652-3420f5f7d02d","Type":"ContainerStarted","Data":"d3628153e9fbd51f2d0c0bfde6931123f0c6e5b8be10d65ac6393cfc98b713c6"} Jul 10 20:25:51.499231 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:51.499202 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-86lbg" event={"ID":"cf57315e-650b-46a7-8d5d-da94f6bf6c95","Type":"ContainerStarted","Data":"323d7387b0900d6e880b5efbd7d459ae661472dd4f41ad609b7e0f804b35a7a0"} Jul 10 20:25:51.499663 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:51.499605 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-86lbg" Jul 10 20:25:51.501442 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:51.501352 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfd85ddcf-n4j4t" event={"ID":"0220e322-a34e-4f38-9e3e-6112244d995f","Type":"ContainerStarted","Data":"8b825bcfcca32e72e85bec2888d826af320cce8b71a215127bf414c94a10efdc"} Jul 10 20:25:51.503609 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:51.503523 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6765b947fd-kmjq6" event={"ID":"753a981b-f047-46c5-b034-10145ec7e361","Type":"ContainerStarted","Data":"24597e506f88ae4c6561b14f38462b2050570a42a5d06c33edb871b6b19571ad"} Jul 10 20:25:51.506500 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:51.506275 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-p8f9b" Jul 10 20:25:51.506500 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:51.506449 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-86lbg" Jul 10 20:25:51.511885 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:51.511556 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-p8f9b" podStartSLOduration=2.394609181 podStartE2EDuration="22.511538863s" totalImagesPullingTime="20.116929682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:51.50924089 +0000 UTC m=+272.969445715" watchObservedRunningTime="2026-07-10 20:25:51.511538863 +0000 UTC m=+272.971743690" Jul 10 20:25:51.540144 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:51.539777 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-86lbg" podStartSLOduration=2.528522088 podStartE2EDuration="12.53975536s" totalImagesPullingTime="10.011233272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:51.537838278 +0000 UTC m=+272.998043106" watchObservedRunningTime="2026-07-10 20:25:51.53975536 +0000 UTC m=+272.999960166" Jul 10 20:25:54.946509 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:54.946466 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" podUID="5fea9949-e4ff-45fc-982a-c634a1d9b074" containerName="registry" containerID="cri-o://7b229dde1e0fbc28d4659c98b484367e8608b079f2fc3c48dbf43192c85e68a5" gracePeriod=30 Jul 10 20:25:55.256022 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.255709 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:55.305451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.297473 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls\") pod \"5fea9949-e4ff-45fc-982a-c634a1d9b074\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " Jul 10 20:25:55.305451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.297532 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fea9949-e4ff-45fc-982a-c634a1d9b074-ca-trust-extracted\") pod \"5fea9949-e4ff-45fc-982a-c634a1d9b074\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " Jul 10 20:25:55.305451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.297568 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-bound-sa-token\") pod \"5fea9949-e4ff-45fc-982a-c634a1d9b074\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " Jul 10 20:25:55.305451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.297610 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-certificates\") pod \"5fea9949-e4ff-45fc-982a-c634a1d9b074\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " Jul 10 20:25:55.305451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.297643 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fea9949-e4ff-45fc-982a-c634a1d9b074-image-registry-private-configuration\") pod \"5fea9949-e4ff-45fc-982a-c634a1d9b074\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " Jul 10 20:25:55.305451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.297699 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdd7q\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-kube-api-access-bdd7q\") pod \"5fea9949-e4ff-45fc-982a-c634a1d9b074\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " Jul 10 20:25:55.305451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.297745 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fea9949-e4ff-45fc-982a-c634a1d9b074-trusted-ca\") pod \"5fea9949-e4ff-45fc-982a-c634a1d9b074\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " Jul 10 20:25:55.305451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.297789 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fea9949-e4ff-45fc-982a-c634a1d9b074-installation-pull-secrets\") pod \"5fea9949-e4ff-45fc-982a-c634a1d9b074\" (UID: \"5fea9949-e4ff-45fc-982a-c634a1d9b074\") " Jul 10 20:25:55.305451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.298297 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5fea9949-e4ff-45fc-982a-c634a1d9b074" (UID: "5fea9949-e4ff-45fc-982a-c634a1d9b074"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:25:55.305451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.298424 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-certificates\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:25:55.305451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.301452 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fea9949-e4ff-45fc-982a-c634a1d9b074-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5fea9949-e4ff-45fc-982a-c634a1d9b074" (UID: "5fea9949-e4ff-45fc-982a-c634a1d9b074"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:25:55.305451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.301592 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5fea9949-e4ff-45fc-982a-c634a1d9b074" (UID: "5fea9949-e4ff-45fc-982a-c634a1d9b074"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:25:55.305451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.303054 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-kube-api-access-bdd7q" (OuterVolumeSpecName: "kube-api-access-bdd7q") pod "5fea9949-e4ff-45fc-982a-c634a1d9b074" (UID: "5fea9949-e4ff-45fc-982a-c634a1d9b074"). InnerVolumeSpecName "kube-api-access-bdd7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:25:55.305451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.303627 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fea9949-e4ff-45fc-982a-c634a1d9b074-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5fea9949-e4ff-45fc-982a-c634a1d9b074" (UID: "5fea9949-e4ff-45fc-982a-c634a1d9b074"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:25:55.305451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.304241 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fea9949-e4ff-45fc-982a-c634a1d9b074-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5fea9949-e4ff-45fc-982a-c634a1d9b074" (UID: "5fea9949-e4ff-45fc-982a-c634a1d9b074"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:25:55.308533 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.308490 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5fea9949-e4ff-45fc-982a-c634a1d9b074" (UID: "5fea9949-e4ff-45fc-982a-c634a1d9b074"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:25:55.318595 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.318556 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fea9949-e4ff-45fc-982a-c634a1d9b074-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5fea9949-e4ff-45fc-982a-c634a1d9b074" (UID: "5fea9949-e4ff-45fc-982a-c634a1d9b074"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:25:55.399288 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.399254 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdd7q\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-kube-api-access-bdd7q\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:25:55.399288 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.399288 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5fea9949-e4ff-45fc-982a-c634a1d9b074-trusted-ca\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:25:55.399549 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.399303 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5fea9949-e4ff-45fc-982a-c634a1d9b074-installation-pull-secrets\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:25:55.399549 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.399317 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-registry-tls\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:25:55.399549 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.399329 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5fea9949-e4ff-45fc-982a-c634a1d9b074-ca-trust-extracted\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:25:55.399549 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.399337 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5fea9949-e4ff-45fc-982a-c634a1d9b074-bound-sa-token\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:25:55.399549 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.399345 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5fea9949-e4ff-45fc-982a-c634a1d9b074-image-registry-private-configuration\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:25:55.526011 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.525899 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flfd4" event={"ID":"9a68b4c6-47ad-4089-a652-3420f5f7d02d","Type":"ContainerStarted","Data":"7b5f92546908dfa26fd460725fc1f426904240dc02ef96924d003f69d1e8816a"} Jul 10 20:25:55.528117 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.528084 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfd85ddcf-n4j4t" event={"ID":"0220e322-a34e-4f38-9e3e-6112244d995f","Type":"ContainerStarted","Data":"8bdbd2f2cadb07805aaac362fee9d25596e0e432a1778746bce28ea1740c7f55"} Jul 10 20:25:55.530211 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.530181 2580 generic.go:356] "Generic (PLEG): container finished" podID="5fea9949-e4ff-45fc-982a-c634a1d9b074" containerID="7b229dde1e0fbc28d4659c98b484367e8608b079f2fc3c48dbf43192c85e68a5" exitCode=0 Jul 10 20:25:55.530330 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.530305 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" Jul 10 20:25:55.530877 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.530855 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" event={"ID":"5fea9949-e4ff-45fc-982a-c634a1d9b074","Type":"ContainerDied","Data":"7b229dde1e0fbc28d4659c98b484367e8608b079f2fc3c48dbf43192c85e68a5"} Jul 10 20:25:55.530968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.530900 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78b9d75b5b-wfpbd" event={"ID":"5fea9949-e4ff-45fc-982a-c634a1d9b074","Type":"ContainerDied","Data":"ef8797074303650128ea01098dd28482321f62f6b5d02561ff163fd35b1fb797"} Jul 10 20:25:55.530968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.530926 2580 scope.go:117] "RemoveContainer" containerID="7b229dde1e0fbc28d4659c98b484367e8608b079f2fc3c48dbf43192c85e68a5" Jul 10 20:25:55.535255 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.534718 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6765b947fd-kmjq6" event={"ID":"753a981b-f047-46c5-b034-10145ec7e361","Type":"ContainerStarted","Data":"16a14b7c1a4eee72dd5b394a0cbf3c9a10eeab2c15dc4386817d2583f249f1ec"} Jul 10 20:25:55.543067 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.543022 2580 scope.go:117] "RemoveContainer" containerID="7b229dde1e0fbc28d4659c98b484367e8608b079f2fc3c48dbf43192c85e68a5" Jul 10 20:25:55.543388 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:55.543357 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b229dde1e0fbc28d4659c98b484367e8608b079f2fc3c48dbf43192c85e68a5\": container with ID starting with 7b229dde1e0fbc28d4659c98b484367e8608b079f2fc3c48dbf43192c85e68a5 not found: ID does not exist" containerID="7b229dde1e0fbc28d4659c98b484367e8608b079f2fc3c48dbf43192c85e68a5" Jul 10 20:25:55.543503 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.543400 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b229dde1e0fbc28d4659c98b484367e8608b079f2fc3c48dbf43192c85e68a5"} err="failed to get container status \"7b229dde1e0fbc28d4659c98b484367e8608b079f2fc3c48dbf43192c85e68a5\": rpc error: code = NotFound desc = could not find container \"7b229dde1e0fbc28d4659c98b484367e8608b079f2fc3c48dbf43192c85e68a5\": container with ID starting with 7b229dde1e0fbc28d4659c98b484367e8608b079f2fc3c48dbf43192c85e68a5 not found: ID does not exist" Jul 10 20:25:55.545782 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.545709 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bfd85ddcf-n4j4t" podStartSLOduration=6.968450719 podStartE2EDuration="11.545691266s" totalImagesPullingTime="4.577240547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:55.545123948 +0000 UTC m=+277.005328775" watchObservedRunningTime="2026-07-10 20:25:55.545691266 +0000 UTC m=+277.005896093" Jul 10 20:25:55.562450 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.562380 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6765b947fd-kmjq6" podStartSLOduration=2.126725306 podStartE2EDuration="6.562359695s" totalImagesPullingTime="4.435634389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:55.562173153 +0000 UTC m=+277.022377980" watchObservedRunningTime="2026-07-10 20:25:55.562359695 +0000 UTC m=+277.022564522" Jul 10 20:25:55.577061 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.577026 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78b9d75b5b-wfpbd"] Jul 10 20:25:55.580705 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.580653 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78b9d75b5b-wfpbd"] Jul 10 20:25:55.661540 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:55.661504 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fea9949-e4ff-45fc-982a-c634a1d9b074" path="/var/lib/kubelet/pods/5fea9949-e4ff-45fc-982a-c634a1d9b074/volumes" Jul 10 20:25:56.417209 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.417175 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6"] Jul 10 20:25:56.417644 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.417483 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fea9949-e4ff-45fc-982a-c634a1d9b074" containerName="registry" Jul 10 20:25:56.417644 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.417495 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fea9949-e4ff-45fc-982a-c634a1d9b074" containerName="registry" Jul 10 20:25:56.417644 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.417548 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fea9949-e4ff-45fc-982a-c634a1d9b074" containerName="registry" Jul 10 20:25:56.434343 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.434309 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" Jul 10 20:25:56.435670 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.435641 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6"] Jul 10 20:25:56.438809 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.438227 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 10 20:25:56.438809 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.438292 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 10 20:25:56.438809 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.438582 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kjn9c\"" Jul 10 20:25:56.446268 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.439172 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 20:25:56.471973 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.471930 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4xvjn"] Jul 10 20:25:56.491721 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.491683 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.495404 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.495174 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d9kfq\"" Jul 10 20:25:56.495404 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.495235 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 20:25:56.495404 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.495238 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 20:25:56.495911 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.495709 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 20:25:56.513437 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.513396 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fe170b0-4b9f-4838-b34f-49ccd58c9ea1-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-jcqx6\" (UID: \"4fe170b0-4b9f-4838-b34f-49ccd58c9ea1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" Jul 10 20:25:56.513600 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.513496 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fe170b0-4b9f-4838-b34f-49ccd58c9ea1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-jcqx6\" (UID: \"4fe170b0-4b9f-4838-b34f-49ccd58c9ea1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" Jul 10 20:25:56.513600 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.513531 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4r6x\" (UniqueName: \"kubernetes.io/projected/4fe170b0-4b9f-4838-b34f-49ccd58c9ea1-kube-api-access-c4r6x\") pod \"openshift-state-metrics-84bd68b896-jcqx6\" (UID: \"4fe170b0-4b9f-4838-b34f-49ccd58c9ea1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" Jul 10 20:25:56.513600 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.513571 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fe170b0-4b9f-4838-b34f-49ccd58c9ea1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-jcqx6\" (UID: \"4fe170b0-4b9f-4838-b34f-49ccd58c9ea1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" Jul 10 20:25:56.614431 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.614382 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fe170b0-4b9f-4838-b34f-49ccd58c9ea1-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-jcqx6\" (UID: \"4fe170b0-4b9f-4838-b34f-49ccd58c9ea1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" Jul 10 20:25:56.614676 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.614518 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af82c0ee-1d4c-4241-a521-7785a1473835-metrics-client-ca\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.615225 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.614868 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.615225 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.615169 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gzjt\" (UniqueName: \"kubernetes.io/projected/af82c0ee-1d4c-4241-a521-7785a1473835-kube-api-access-5gzjt\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.615225 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.615210 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-wtmp\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.615484 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.615251 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af82c0ee-1d4c-4241-a521-7785a1473835-sys\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.615484 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.615306 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-tls\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.615484 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.615338 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fe170b0-4b9f-4838-b34f-49ccd58c9ea1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-jcqx6\" (UID: \"4fe170b0-4b9f-4838-b34f-49ccd58c9ea1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" Jul 10 20:25:56.615484 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.615369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4r6x\" (UniqueName: \"kubernetes.io/projected/4fe170b0-4b9f-4838-b34f-49ccd58c9ea1-kube-api-access-c4r6x\") pod \"openshift-state-metrics-84bd68b896-jcqx6\" (UID: \"4fe170b0-4b9f-4838-b34f-49ccd58c9ea1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" Jul 10 20:25:56.615484 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.615437 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-textfile\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.615484 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.615449 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fe170b0-4b9f-4838-b34f-49ccd58c9ea1-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-jcqx6\" (UID: \"4fe170b0-4b9f-4838-b34f-49ccd58c9ea1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" Jul 10 20:25:56.615861 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.615497 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fe170b0-4b9f-4838-b34f-49ccd58c9ea1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-jcqx6\" (UID: \"4fe170b0-4b9f-4838-b34f-49ccd58c9ea1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" Jul 10 20:25:56.615861 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.615635 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-accelerators-collector-config\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.615861 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.615677 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af82c0ee-1d4c-4241-a521-7785a1473835-root\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.615861 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:56.615846 2580 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 10 20:25:56.616045 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:56.615913 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fe170b0-4b9f-4838-b34f-49ccd58c9ea1-openshift-state-metrics-tls podName:4fe170b0-4b9f-4838-b34f-49ccd58c9ea1 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:57.115893264 +0000 UTC m=+278.576098078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4fe170b0-4b9f-4838-b34f-49ccd58c9ea1-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-jcqx6" (UID: "4fe170b0-4b9f-4838-b34f-49ccd58c9ea1") : secret "openshift-state-metrics-tls" not found Jul 10 20:25:56.619293 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.619268 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4fe170b0-4b9f-4838-b34f-49ccd58c9ea1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-jcqx6\" (UID: \"4fe170b0-4b9f-4838-b34f-49ccd58c9ea1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" Jul 10 20:25:56.625866 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.625818 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4r6x\" (UniqueName: \"kubernetes.io/projected/4fe170b0-4b9f-4838-b34f-49ccd58c9ea1-kube-api-access-c4r6x\") pod \"openshift-state-metrics-84bd68b896-jcqx6\" (UID: \"4fe170b0-4b9f-4838-b34f-49ccd58c9ea1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" Jul 10 20:25:56.716661 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.716547 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-textfile\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.716661 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.716625 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-accelerators-collector-config\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.716941 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.716669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af82c0ee-1d4c-4241-a521-7785a1473835-root\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.716941 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.716714 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af82c0ee-1d4c-4241-a521-7785a1473835-metrics-client-ca\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.716941 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.716745 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.716941 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.716773 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gzjt\" (UniqueName: \"kubernetes.io/projected/af82c0ee-1d4c-4241-a521-7785a1473835-kube-api-access-5gzjt\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.716941 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.716799 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-wtmp\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.716941 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.716826 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af82c0ee-1d4c-4241-a521-7785a1473835-sys\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.717525 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.717169 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/af82c0ee-1d4c-4241-a521-7785a1473835-root\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.717525 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.717228 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-tls\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.717525 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:56.717389 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 10 20:25:56.717525 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:56.717444 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-tls podName:af82c0ee-1d4c-4241-a521-7785a1473835 nodeName:}" failed. No retries permitted until 2026-07-10 20:25:57.217426569 +0000 UTC m=+278.677631392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-tls") pod "node-exporter-4xvjn" (UID: "af82c0ee-1d4c-4241-a521-7785a1473835") : secret "node-exporter-tls" not found Jul 10 20:25:56.717525 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.717490 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af82c0ee-1d4c-4241-a521-7785a1473835-sys\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.717836 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.717622 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-wtmp\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.717836 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.717638 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-accelerators-collector-config\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.718093 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.718070 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-textfile\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.718222 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.718099 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af82c0ee-1d4c-4241-a521-7785a1473835-metrics-client-ca\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.720836 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.720808 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:56.726813 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:56.726767 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gzjt\" (UniqueName: \"kubernetes.io/projected/af82c0ee-1d4c-4241-a521-7785a1473835-kube-api-access-5gzjt\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:57.121710 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.121633 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fe170b0-4b9f-4838-b34f-49ccd58c9ea1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-jcqx6\" (UID: \"4fe170b0-4b9f-4838-b34f-49ccd58c9ea1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" Jul 10 20:25:57.124603 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.124554 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4fe170b0-4b9f-4838-b34f-49ccd58c9ea1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-jcqx6\" (UID: \"4fe170b0-4b9f-4838-b34f-49ccd58c9ea1\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" Jul 10 20:25:57.222957 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.222861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-tls\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:57.226503 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.226443 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/af82c0ee-1d4c-4241-a521-7785a1473835-node-exporter-tls\") pod \"node-exporter-4xvjn\" (UID: \"af82c0ee-1d4c-4241-a521-7785a1473835\") " pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:57.353688 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.353643 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" Jul 10 20:25:57.404575 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.404483 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4xvjn" Jul 10 20:25:57.492856 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.492580 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 20:25:57.516953 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.516918 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 20:25:57.517171 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.517113 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.521856 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.521827 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 20:25:57.522380 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.521923 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 20:25:57.522380 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.521952 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 20:25:57.522380 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.521973 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 20:25:57.522380 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.522084 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 20:25:57.522380 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.522183 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 20:25:57.522380 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.522276 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 20:25:57.522380 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.522328 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 20:25:57.522380 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.522376 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 20:25:57.522972 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.522670 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tjzdw\"" Jul 10 20:25:57.628072 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.627456 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47746ee2-2e13-4494-8892-3853327945ab-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.628072 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.627506 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47746ee2-2e13-4494-8892-3853327945ab-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.628072 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.627536 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/47746ee2-2e13-4494-8892-3853327945ab-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.628072 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.627571 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47746ee2-2e13-4494-8892-3853327945ab-config-out\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.628072 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.627595 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.628072 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.627643 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.628072 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.627690 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsvl5\" (UniqueName: \"kubernetes.io/projected/47746ee2-2e13-4494-8892-3853327945ab-kube-api-access-tsvl5\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.628072 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.627754 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47746ee2-2e13-4494-8892-3853327945ab-tls-assets\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.628072 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.627780 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.628072 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.627803 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.628072 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.627845 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-web-config\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.628072 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.627876 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.628072 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.627919 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-config-volume\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.729027 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.728927 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.729027 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.728982 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-config-volume\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.729027 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.729024 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47746ee2-2e13-4494-8892-3853327945ab-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.729339 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.729061 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47746ee2-2e13-4494-8892-3853327945ab-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.729339 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.729090 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/47746ee2-2e13-4494-8892-3853327945ab-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.729339 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.729113 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47746ee2-2e13-4494-8892-3853327945ab-config-out\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.729339 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.729161 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.729339 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.729217 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.729339 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.729267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsvl5\" (UniqueName: \"kubernetes.io/projected/47746ee2-2e13-4494-8892-3853327945ab-kube-api-access-tsvl5\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.729339 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.729297 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47746ee2-2e13-4494-8892-3853327945ab-tls-assets\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.729339 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.729321 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.729712 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.729344 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.729712 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.729394 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-web-config\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.731053 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:25:57.730588 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47746ee2-2e13-4494-8892-3853327945ab-alertmanager-trusted-ca-bundle podName:47746ee2-2e13-4494-8892-3853327945ab nodeName:}" failed. No retries permitted until 2026-07-10 20:25:58.230564185 +0000 UTC m=+279.690768990 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/47746ee2-2e13-4494-8892-3853327945ab-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "47746ee2-2e13-4494-8892-3853327945ab") : configmap references non-existent config key: ca-bundle.crt Jul 10 20:25:57.731645 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.731619 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47746ee2-2e13-4494-8892-3853327945ab-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.731909 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.731887 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/47746ee2-2e13-4494-8892-3853327945ab-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.735442 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.733958 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47746ee2-2e13-4494-8892-3853327945ab-tls-assets\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.735442 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.734262 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47746ee2-2e13-4494-8892-3853327945ab-config-out\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.735442 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.734620 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-web-config\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.735442 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.734909 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.738121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.736078 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.738121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.736584 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.738121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.736583 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.738121 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.737096 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-config-volume\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.738352 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.738295 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.739290 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:57.739268 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsvl5\" (UniqueName: \"kubernetes.io/projected/47746ee2-2e13-4494-8892-3853327945ab-kube-api-access-tsvl5\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:57.918920 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:25:57.918889 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf82c0ee_1d4c_4241_a521_7785a1473835.slice/crio-3e1cba46f6b42046a13a8f27f3cd70a2cb29d2ad379b54de247e3bc2beaf37c5 WatchSource:0}: Error finding container 3e1cba46f6b42046a13a8f27f3cd70a2cb29d2ad379b54de247e3bc2beaf37c5: Status 404 returned error can't find the container with id 3e1cba46f6b42046a13a8f27f3cd70a2cb29d2ad379b54de247e3bc2beaf37c5 Jul 10 20:25:58.066102 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:58.066068 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6"] Jul 10 20:25:58.069527 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:25:58.069490 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fe170b0_4b9f_4838_b34f_49ccd58c9ea1.slice/crio-d733838f30c136473a4c30f4715767bfae28664b0d4e2843b2ddab348993c39e WatchSource:0}: Error finding container d733838f30c136473a4c30f4715767bfae28664b0d4e2843b2ddab348993c39e: Status 404 returned error can't find the container with id d733838f30c136473a4c30f4715767bfae28664b0d4e2843b2ddab348993c39e Jul 10 20:25:58.234666 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:58.234627 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47746ee2-2e13-4494-8892-3853327945ab-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:58.235574 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:58.235545 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47746ee2-2e13-4494-8892-3853327945ab-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:58.432998 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:58.432968 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:25:58.553871 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:58.553689 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" event={"ID":"4fe170b0-4b9f-4838-b34f-49ccd58c9ea1","Type":"ContainerStarted","Data":"e3b3e3071bf0c7ec7ccd86de207d32dbe6ffd02cfec903a3f882efc4c896e911"} Jul 10 20:25:58.553871 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:58.553793 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" event={"ID":"4fe170b0-4b9f-4838-b34f-49ccd58c9ea1","Type":"ContainerStarted","Data":"d27abcd13718cd090e18cef1e34117498914650fd348933662d4841fce0ee508"} Jul 10 20:25:58.553871 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:58.553824 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" event={"ID":"4fe170b0-4b9f-4838-b34f-49ccd58c9ea1","Type":"ContainerStarted","Data":"d733838f30c136473a4c30f4715767bfae28664b0d4e2843b2ddab348993c39e"} Jul 10 20:25:58.556741 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:58.556700 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4xvjn" event={"ID":"af82c0ee-1d4c-4241-a521-7785a1473835","Type":"ContainerStarted","Data":"3e1cba46f6b42046a13a8f27f3cd70a2cb29d2ad379b54de247e3bc2beaf37c5"} Jul 10 20:25:58.559245 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:58.559221 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flfd4" event={"ID":"9a68b4c6-47ad-4089-a652-3420f5f7d02d","Type":"ContainerStarted","Data":"dc6e41b4de5e5e473d85547fce5fccedc7eec9f3e707336428c7c9308df92662"} Jul 10 20:25:58.641753 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:58.641694 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-flfd4" podStartSLOduration=33.16900845 podStartE2EDuration="51.641669489s" totalImagesPullingTime="18.472661039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 20:25:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:25:58.579601994 +0000 UTC m=+280.039806821" watchObservedRunningTime="2026-07-10 20:25:58.641669489 +0000 UTC m=+280.101874316" Jul 10 20:25:58.642718 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:58.642693 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 20:25:58.645743 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:25:58.645715 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47746ee2_2e13_4494_8892_3853327945ab.slice/crio-9a36af949fb0366860a01a7e371904ce488e0a73b80f75dbc2684189ceda618b WatchSource:0}: Error finding container 9a36af949fb0366860a01a7e371904ce488e0a73b80f75dbc2684189ceda618b: Status 404 returned error can't find the container with id 9a36af949fb0366860a01a7e371904ce488e0a73b80f75dbc2684189ceda618b Jul 10 20:25:59.413476 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.413442 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29"] Jul 10 20:25:59.427141 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.427096 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.430912 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.430332 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 10 20:25:59.430912 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.430582 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 10 20:25:59.430912 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.430796 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 10 20:25:59.430912 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.430881 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29"] Jul 10 20:25:59.431244 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.431045 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 10 20:25:59.431244 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.431067 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cujvlhqnvjcto\"" Jul 10 20:25:59.431369 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.431346 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 10 20:25:59.431504 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.431490 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-gl2dd\"" Jul 10 20:25:59.553167 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.553105 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.553354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.553187 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.553354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.553254 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.553354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.553284 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68a2416b-0367-4440-8de7-4b53b4bdaee2-metrics-client-ca\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.553354 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.553319 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.553529 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.553428 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-thanos-querier-tls\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.553529 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.553459 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2sbt\" (UniqueName: \"kubernetes.io/projected/68a2416b-0367-4440-8de7-4b53b4bdaee2-kube-api-access-l2sbt\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.553529 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.553488 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-grpc-tls\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.565035 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.564993 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47746ee2-2e13-4494-8892-3853327945ab","Type":"ContainerStarted","Data":"9a36af949fb0366860a01a7e371904ce488e0a73b80f75dbc2684189ceda618b"} Jul 10 20:25:59.654192 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.654123 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-grpc-tls\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.654377 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.654235 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.654821 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.654556 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.654821 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.654680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.654821 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.654726 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68a2416b-0367-4440-8de7-4b53b4bdaee2-metrics-client-ca\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.654821 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.654763 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.655094 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.654827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-thanos-querier-tls\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.655094 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.654855 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2sbt\" (UniqueName: \"kubernetes.io/projected/68a2416b-0367-4440-8de7-4b53b4bdaee2-kube-api-access-l2sbt\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.656048 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.655991 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68a2416b-0367-4440-8de7-4b53b4bdaee2-metrics-client-ca\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.657683 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.657657 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.657924 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.657876 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.658030 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.657979 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-thanos-querier-tls\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.658654 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.658626 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-grpc-tls\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.659065 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.659036 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.659276 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.659253 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68a2416b-0367-4440-8de7-4b53b4bdaee2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.663754 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.663699 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2sbt\" (UniqueName: \"kubernetes.io/projected/68a2416b-0367-4440-8de7-4b53b4bdaee2-kube-api-access-l2sbt\") pod \"thanos-querier-6c4dbf6bc6-2kw29\" (UID: \"68a2416b-0367-4440-8de7-4b53b4bdaee2\") " pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:25:59.740001 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:25:59.739966 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:26:00.191694 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:00.191658 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:26:00.191855 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:00.191772 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:26:00.193203 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:00.193176 2580 patch_prober.go:28] interesting pod/console-6765b947fd-kmjq6 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jul 10 20:26:00.193690 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:00.193410 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6765b947fd-kmjq6" podUID="753a981b-f047-46c5-b034-10145ec7e361" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jul 10 20:26:00.193771 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:00.193656 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29"] Jul 10 20:26:00.193830 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:26:00.193659 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68a2416b_0367_4440_8de7_4b53b4bdaee2.slice/crio-18668b0388d08bd5c7de6ba921423830cf6ceeb7cca28a6ef5f96c8951d4753b WatchSource:0}: Error finding container 18668b0388d08bd5c7de6ba921423830cf6ceeb7cca28a6ef5f96c8951d4753b: Status 404 returned error can't find the container with id 18668b0388d08bd5c7de6ba921423830cf6ceeb7cca28a6ef5f96c8951d4753b Jul 10 20:26:00.570037 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:00.570002 2580 generic.go:356] "Generic (PLEG): container finished" podID="af82c0ee-1d4c-4241-a521-7785a1473835" containerID="a5da901da7fde39a44bfa1e4d69d5a3c4a69829eaf28dbb04f6879ec2ad13e88" exitCode=0 Jul 10 20:26:00.570574 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:00.570091 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4xvjn" event={"ID":"af82c0ee-1d4c-4241-a521-7785a1473835","Type":"ContainerDied","Data":"a5da901da7fde39a44bfa1e4d69d5a3c4a69829eaf28dbb04f6879ec2ad13e88"} Jul 10 20:26:00.571276 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:00.571254 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" event={"ID":"68a2416b-0367-4440-8de7-4b53b4bdaee2","Type":"ContainerStarted","Data":"18668b0388d08bd5c7de6ba921423830cf6ceeb7cca28a6ef5f96c8951d4753b"} Jul 10 20:26:01.240803 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.240735 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bfd85ddcf-n4j4t"] Jul 10 20:26:01.277469 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.277436 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7869446888-7wrbp"] Jul 10 20:26:01.292533 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.292507 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7869446888-7wrbp"] Jul 10 20:26:01.292712 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.292616 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.370470 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.370434 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-trusted-ca-bundle\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.370470 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.370474 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/419f5e16-a704-438a-99ce-454f94442fac-console-serving-cert\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.370730 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.370493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v447x\" (UniqueName: \"kubernetes.io/projected/419f5e16-a704-438a-99ce-454f94442fac-kube-api-access-v447x\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.370730 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.370582 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-console-config\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.370730 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.370614 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-oauth-serving-cert\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.370730 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.370663 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/419f5e16-a704-438a-99ce-454f94442fac-console-oauth-config\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.370730 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.370696 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-service-ca\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.471786 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.471748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-trusted-ca-bundle\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.472080 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.471792 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/419f5e16-a704-438a-99ce-454f94442fac-console-serving-cert\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.472080 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.471818 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v447x\" (UniqueName: \"kubernetes.io/projected/419f5e16-a704-438a-99ce-454f94442fac-kube-api-access-v447x\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.472080 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.471896 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-console-config\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.472080 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.471928 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-oauth-serving-cert\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.472080 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.471976 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/419f5e16-a704-438a-99ce-454f94442fac-console-oauth-config\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.472080 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.472036 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-service-ca\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.472728 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.472702 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-oauth-serving-cert\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.472830 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.472750 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-service-ca\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.472830 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.472762 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-trusted-ca-bundle\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.472981 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.472963 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-console-config\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.474526 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.474495 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/419f5e16-a704-438a-99ce-454f94442fac-console-oauth-config\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.474602 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.474583 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/419f5e16-a704-438a-99ce-454f94442fac-console-serving-cert\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.479801 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.479778 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v447x\" (UniqueName: \"kubernetes.io/projected/419f5e16-a704-438a-99ce-454f94442fac-kube-api-access-v447x\") pod \"console-7869446888-7wrbp\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.577929 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.577835 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4xvjn" event={"ID":"af82c0ee-1d4c-4241-a521-7785a1473835","Type":"ContainerStarted","Data":"ffd4de7e07b508d76210b643941496c415d9546a33f575e7a307e2131657efaa"} Jul 10 20:26:01.577929 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.577903 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4xvjn" event={"ID":"af82c0ee-1d4c-4241-a521-7785a1473835","Type":"ContainerStarted","Data":"882493cd8c057317bc5eac22739bd1ce59df421a53cf76beb749d1283df6b79b"} Jul 10 20:26:01.579406 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.579351 2580 generic.go:356] "Generic (PLEG): container finished" podID="47746ee2-2e13-4494-8892-3853327945ab" containerID="9e43c80005244cfc89bddf546361ea326618305f04a856268afd28f692e67f7a" exitCode=0 Jul 10 20:26:01.579505 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.579434 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47746ee2-2e13-4494-8892-3853327945ab","Type":"ContainerDied","Data":"9e43c80005244cfc89bddf546361ea326618305f04a856268afd28f692e67f7a"} Jul 10 20:26:01.581758 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.581736 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" event={"ID":"4fe170b0-4b9f-4838-b34f-49ccd58c9ea1","Type":"ContainerStarted","Data":"0caed3820726f74bfbe515ba6c6e58423ee48411bc79903f28f09e4623ed7fa0"} Jul 10 20:26:01.597642 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.597553 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4xvjn" podStartSLOduration=3.371551001 podStartE2EDuration="5.597536305s" totalImagesPullingTime="2.128288205s" totalInitContainerRuntime="97.697099ms" isStatefulPod=true podCreationTimestamp="2026-07-10 20:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:26:01.595756338 +0000 UTC m=+283.055961164" watchObservedRunningTime="2026-07-10 20:26:01.597536305 +0000 UTC m=+283.057741131" Jul 10 20:26:01.601364 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.601341 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:01.665533 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.665483 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-jcqx6" podStartSLOduration=3.552343815 podStartE2EDuration="5.665463566s" totalImagesPullingTime="2.113119751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:26:01.663288203 +0000 UTC m=+283.123493028" watchObservedRunningTime="2026-07-10 20:26:01.665463566 +0000 UTC m=+283.125668393" Jul 10 20:26:01.778784 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:01.778753 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7869446888-7wrbp"] Jul 10 20:26:01.781765 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:26:01.781741 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod419f5e16_a704_438a_99ce_454f94442fac.slice/crio-0c2174fa227bafe1538a381537497893902a8d463df0320c520cc37f1c0dd7e0 WatchSource:0}: Error finding container 0c2174fa227bafe1538a381537497893902a8d463df0320c520cc37f1c0dd7e0: Status 404 returned error can't find the container with id 0c2174fa227bafe1538a381537497893902a8d463df0320c520cc37f1c0dd7e0 Jul 10 20:26:02.140338 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:26:02.140302 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xjz7l" podUID="c32bbb4b-0f56-4f0c-971e-660dd1b6f01c" Jul 10 20:26:02.591040 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:02.590950 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7869446888-7wrbp" event={"ID":"419f5e16-a704-438a-99ce-454f94442fac","Type":"ContainerStarted","Data":"98e41ee1a51993ae99edcc41aad0bde09392f6ecf4fb6775edba0685fd0682c1"} Jul 10 20:26:02.591040 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:02.591009 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7869446888-7wrbp" event={"ID":"419f5e16-a704-438a-99ce-454f94442fac","Type":"ContainerStarted","Data":"0c2174fa227bafe1538a381537497893902a8d463df0320c520cc37f1c0dd7e0"} Jul 10 20:26:02.591647 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:02.591306 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xjz7l" Jul 10 20:26:02.608728 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:02.608677 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7869446888-7wrbp" podStartSLOduration=1.608658113 podStartE2EDuration="1.608658113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:26:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:26:02.607522455 +0000 UTC m=+284.067727307" watchObservedRunningTime="2026-07-10 20:26:02.608658113 +0000 UTC m=+284.068862940" Jul 10 20:26:04.582193 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:04.582168 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:26:05.310892 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:05.310854 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:26:05.313141 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:05.313107 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c32bbb4b-0f56-4f0c-971e-660dd1b6f01c-metrics-tls\") pod \"dns-default-xjz7l\" (UID: \"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c\") " pod="openshift-dns/dns-default-xjz7l" Jul 10 20:26:05.593992 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:05.593958 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sgw85\"" Jul 10 20:26:05.601982 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:05.601953 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xjz7l" Jul 10 20:26:05.607001 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:05.606973 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" event={"ID":"68a2416b-0367-4440-8de7-4b53b4bdaee2","Type":"ContainerStarted","Data":"b6970958a29edb0d1566b35221f12eeb3a79a8c7ae469d2757c0488010d142f4"} Jul 10 20:26:05.607200 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:05.607044 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" event={"ID":"68a2416b-0367-4440-8de7-4b53b4bdaee2","Type":"ContainerStarted","Data":"c5875f2b5f023992707bd01e6290de69a7f9c3b491f6aad212a2bcfd2b361d4e"} Jul 10 20:26:05.607200 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:05.607072 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" event={"ID":"68a2416b-0367-4440-8de7-4b53b4bdaee2","Type":"ContainerStarted","Data":"9dcfecb8445da5fa6c6fcfbdccf6f11d0a53bb9b2973ccf630bc576c81e25e68"} Jul 10 20:26:05.609846 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:05.609822 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47746ee2-2e13-4494-8892-3853327945ab","Type":"ContainerStarted","Data":"7bdbce9339cc48e21e011bf78d44993b40806a3cb098089c3311c91936cf7db7"} Jul 10 20:26:05.609942 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:05.609892 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47746ee2-2e13-4494-8892-3853327945ab","Type":"ContainerStarted","Data":"f1fd72768d99e052c0b1cd51d88bb9bf9b4034e02b481f73282a3ca9b9824974"} Jul 10 20:26:05.609942 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:05.609935 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47746ee2-2e13-4494-8892-3853327945ab","Type":"ContainerStarted","Data":"d99a0545f7c3ca53dab6aeb096101db10f6861b6e01a766d30009cd4d8779a90"} Jul 10 20:26:05.610046 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:05.609979 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47746ee2-2e13-4494-8892-3853327945ab","Type":"ContainerStarted","Data":"dc8d59f93593e2e7ef302eb6efb6aa933485bc34241e21b2928f7ef74a6e576f"} Jul 10 20:26:05.610046 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:05.610017 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47746ee2-2e13-4494-8892-3853327945ab","Type":"ContainerStarted","Data":"c84d38da53d4767351effefe521338bd79755854f0487bc27266daa542ebf92d"} Jul 10 20:26:05.755604 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:05.755570 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xjz7l"] Jul 10 20:26:05.758899 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:26:05.758866 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc32bbb4b_0f56_4f0c_971e_660dd1b6f01c.slice/crio-1050c8a62b584b2e57674ab8d93f9596582dd89242e941824c0b2ef6e65e4bd6 WatchSource:0}: Error finding container 1050c8a62b584b2e57674ab8d93f9596582dd89242e941824c0b2ef6e65e4bd6: Status 404 returned error can't find the container with id 1050c8a62b584b2e57674ab8d93f9596582dd89242e941824c0b2ef6e65e4bd6 Jul 10 20:26:06.100707 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.100668 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6765b947fd-kmjq6"] Jul 10 20:26:06.127957 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.127924 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5467db77bd-6vz7d"] Jul 10 20:26:06.139206 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.139180 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.141976 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.141950 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5467db77bd-6vz7d"] Jul 10 20:26:06.219047 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.219012 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-oauth-serving-cert\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.219390 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.219061 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-config\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.219390 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.219092 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-service-ca\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.219390 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.219115 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-trusted-ca-bundle\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.219390 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.219167 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-serving-cert\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.219390 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.219191 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g272t\" (UniqueName: \"kubernetes.io/projected/492b53ed-21d6-4b3c-877e-fd7efbad4d73-kube-api-access-g272t\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.219390 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.219227 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-oauth-config\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.319815 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.319784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-config\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.320002 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.319828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-service-ca\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.320002 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.319850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-trusted-ca-bundle\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.320002 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.319883 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-serving-cert\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.320002 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.319904 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g272t\" (UniqueName: \"kubernetes.io/projected/492b53ed-21d6-4b3c-877e-fd7efbad4d73-kube-api-access-g272t\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.320002 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.319948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-oauth-config\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.320002 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.319980 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-oauth-serving-cert\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.320578 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.320538 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-service-ca\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.320702 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.320648 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-config\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.320757 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.320695 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-oauth-serving-cert\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.320878 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.320859 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-trusted-ca-bundle\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.322531 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.322503 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-oauth-config\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.322612 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.322511 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-serving-cert\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.330784 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.330763 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g272t\" (UniqueName: \"kubernetes.io/projected/492b53ed-21d6-4b3c-877e-fd7efbad4d73-kube-api-access-g272t\") pod \"console-5467db77bd-6vz7d\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.449304 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.449261 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:06.618379 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.618316 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xjz7l" event={"ID":"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c","Type":"ContainerStarted","Data":"1050c8a62b584b2e57674ab8d93f9596582dd89242e941824c0b2ef6e65e4bd6"} Jul 10 20:26:06.710941 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:06.710702 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5467db77bd-6vz7d"] Jul 10 20:26:06.714671 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:26:06.714645 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod492b53ed_21d6_4b3c_877e_fd7efbad4d73.slice/crio-4f285dc9cb895ff45729ce70c7767ab6994d719ddd50b8e05b4bb7b022c614e6 WatchSource:0}: Error finding container 4f285dc9cb895ff45729ce70c7767ab6994d719ddd50b8e05b4bb7b022c614e6: Status 404 returned error can't find the container with id 4f285dc9cb895ff45729ce70c7767ab6994d719ddd50b8e05b4bb7b022c614e6 Jul 10 20:26:07.626755 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:07.626723 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" event={"ID":"68a2416b-0367-4440-8de7-4b53b4bdaee2","Type":"ContainerStarted","Data":"e5b68ce987a495d286a9253436fc9fe3cbafabb9f57f7246b71994e32e4b8dfe"} Jul 10 20:26:07.627433 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:07.626791 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" event={"ID":"68a2416b-0367-4440-8de7-4b53b4bdaee2","Type":"ContainerStarted","Data":"90f151ddc21c13ac98bb2ec8935572da7d5781220d5be475c490ce082106bdbb"} Jul 10 20:26:07.627433 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:07.626833 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" event={"ID":"68a2416b-0367-4440-8de7-4b53b4bdaee2","Type":"ContainerStarted","Data":"aa8dcffb82f951fffe3672b455b6b927ed830c763156c685015163c928151662"} Jul 10 20:26:07.627433 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:07.626997 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:26:07.628376 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:07.628350 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5467db77bd-6vz7d" event={"ID":"492b53ed-21d6-4b3c-877e-fd7efbad4d73","Type":"ContainerStarted","Data":"c5d3088fc9fe135ff6873c16484789083f78a0a0c33e42fbcb059fadfad83be3"} Jul 10 20:26:07.628478 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:07.628389 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5467db77bd-6vz7d" event={"ID":"492b53ed-21d6-4b3c-877e-fd7efbad4d73","Type":"ContainerStarted","Data":"4f285dc9cb895ff45729ce70c7767ab6994d719ddd50b8e05b4bb7b022c614e6"} Jul 10 20:26:07.631358 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:07.631332 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47746ee2-2e13-4494-8892-3853327945ab","Type":"ContainerStarted","Data":"55081569ba6512e3c100a6d8f536daaa5396031087440df47e782c7eb931f449"} Jul 10 20:26:07.652319 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:07.652268 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" podStartSLOduration=2.627481895 podStartE2EDuration="8.652252836s" totalImagesPullingTime="6.024770941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:26:07.65103945 +0000 UTC m=+289.111244277" watchObservedRunningTime="2026-07-10 20:26:07.652252836 +0000 UTC m=+289.112457661" Jul 10 20:26:07.681348 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:07.681275 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.953329589 podStartE2EDuration="10.681250979s" totalImagesPullingTime="6.692084923s" totalInitContainerRuntime="35.836467ms" isStatefulPod=false podCreationTimestamp="2026-07-10 20:25:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:26:07.678416282 +0000 UTC m=+289.138621107" watchObservedRunningTime="2026-07-10 20:26:07.681250979 +0000 UTC m=+289.141455806" Jul 10 20:26:07.698703 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:07.698636 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5467db77bd-6vz7d" podStartSLOduration=1.698611876 podStartE2EDuration="1.698611876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:26:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:26:07.696112865 +0000 UTC m=+289.156317704" watchObservedRunningTime="2026-07-10 20:26:07.698611876 +0000 UTC m=+289.158816703" Jul 10 20:26:09.642210 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:09.642176 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xjz7l" event={"ID":"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c","Type":"ContainerStarted","Data":"31a9955b45cafdc36a5912ea6f27befc8066c991024551a603a6883bc1fc8f8e"} Jul 10 20:26:09.642605 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:09.642238 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xjz7l" event={"ID":"c32bbb4b-0f56-4f0c-971e-660dd1b6f01c","Type":"ContainerStarted","Data":"e07918c7a0244c869b894a80f287a63546574fc3e87a3b46e8c3d1dbcab45bee"} Jul 10 20:26:09.642605 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:09.642260 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xjz7l" Jul 10 20:26:09.674632 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:09.674581 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xjz7l" podStartSLOduration=251.49324591 podStartE2EDuration="4m14.674566154s" totalImagesPullingTime="3.181320244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:21:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:26:09.673444679 +0000 UTC m=+291.133649507" watchObservedRunningTime="2026-07-10 20:26:09.674566154 +0000 UTC m=+291.134770980" Jul 10 20:26:11.602190 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:11.602077 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:11.602595 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:11.602222 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:11.603568 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:11.603546 2580 patch_prober.go:28] interesting pod/console-7869446888-7wrbp container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jul 10 20:26:11.603649 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:11.603592 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7869446888-7wrbp" podUID="419f5e16-a704-438a-99ce-454f94442fac" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jul 10 20:26:13.641319 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:13.641291 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6c4dbf6bc6-2kw29" Jul 10 20:26:16.449866 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:16.449824 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:16.450299 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:16.449912 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:16.451367 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:16.451344 2580 patch_prober.go:28] interesting pod/console-5467db77bd-6vz7d container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" start-of-body= Jul 10 20:26:16.451470 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:16.451384 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5467db77bd-6vz7d" podUID="492b53ed-21d6-4b3c-877e-fd7efbad4d73" containerName="console" probeResult="failure" output="Get \"https://10.133.0.24:8443/health\": dial tcp 10.133.0.24:8443: connect: connection refused" Jul 10 20:26:17.677958 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:17.677928 2580 generic.go:356] "Generic (PLEG): container finished" podID="d17091fb-5267-42d2-8683-3b26390a632b" containerID="bf06652e1b6d30b2488bfa980664b89783c36aecfb8d9d67127f411d9d01fb24" exitCode=0 Jul 10 20:26:17.678375 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:17.678006 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf" event={"ID":"d17091fb-5267-42d2-8683-3b26390a632b","Type":"ContainerDied","Data":"bf06652e1b6d30b2488bfa980664b89783c36aecfb8d9d67127f411d9d01fb24"} Jul 10 20:26:17.678445 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:17.678385 2580 scope.go:117] "RemoveContainer" containerID="bf06652e1b6d30b2488bfa980664b89783c36aecfb8d9d67127f411d9d01fb24" Jul 10 20:26:18.684138 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:18.684094 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-6qcbf" event={"ID":"d17091fb-5267-42d2-8683-3b26390a632b","Type":"ContainerStarted","Data":"81bad28a6bd5237f5b42d0b0c385f6e0896916717861ad97b7f3c6bc37ab1cfe"} Jul 10 20:26:19.509970 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:19.509940 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:26:19.511317 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:19.511297 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:26:19.512621 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:19.512607 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 20:26:19.649043 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:19.649005 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xjz7l" Jul 10 20:26:21.606086 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:21.606056 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:21.609888 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:21.609866 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:26.260896 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.260831 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bfd85ddcf-n4j4t" podUID="0220e322-a34e-4f38-9e3e-6112244d995f" containerName="console" containerID="cri-o://8bdbd2f2cadb07805aaac362fee9d25596e0e432a1778746bce28ea1740c7f55" gracePeriod=15 Jul 10 20:26:26.454823 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.454796 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:26.459724 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.459691 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:26:26.516037 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.516006 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7869446888-7wrbp"] Jul 10 20:26:26.552895 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.552867 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:26:26.594007 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.593974 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0220e322-a34e-4f38-9e3e-6112244d995f-console-oauth-config\") pod \"0220e322-a34e-4f38-9e3e-6112244d995f\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " Jul 10 20:26:26.594007 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.594014 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vl8x4\" (UniqueName: \"kubernetes.io/projected/0220e322-a34e-4f38-9e3e-6112244d995f-kube-api-access-vl8x4\") pod \"0220e322-a34e-4f38-9e3e-6112244d995f\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " Jul 10 20:26:26.594276 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.594033 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0220e322-a34e-4f38-9e3e-6112244d995f-console-serving-cert\") pod \"0220e322-a34e-4f38-9e3e-6112244d995f\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " Jul 10 20:26:26.594276 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.594067 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-console-config\") pod \"0220e322-a34e-4f38-9e3e-6112244d995f\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " Jul 10 20:26:26.594276 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.594093 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-service-ca\") pod \"0220e322-a34e-4f38-9e3e-6112244d995f\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " Jul 10 20:26:26.594276 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.594215 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-oauth-serving-cert\") pod \"0220e322-a34e-4f38-9e3e-6112244d995f\" (UID: \"0220e322-a34e-4f38-9e3e-6112244d995f\") " Jul 10 20:26:26.594777 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.594492 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-service-ca" (OuterVolumeSpecName: "service-ca") pod "0220e322-a34e-4f38-9e3e-6112244d995f" (UID: "0220e322-a34e-4f38-9e3e-6112244d995f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:26:26.594777 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.594499 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-console-config" (OuterVolumeSpecName: "console-config") pod "0220e322-a34e-4f38-9e3e-6112244d995f" (UID: "0220e322-a34e-4f38-9e3e-6112244d995f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:26:26.594777 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.594723 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0220e322-a34e-4f38-9e3e-6112244d995f" (UID: "0220e322-a34e-4f38-9e3e-6112244d995f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:26:26.594996 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.594859 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-console-config\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:26.594996 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.594892 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-service-ca\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:26.594996 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.594904 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0220e322-a34e-4f38-9e3e-6112244d995f-oauth-serving-cert\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:26.596410 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.596389 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0220e322-a34e-4f38-9e3e-6112244d995f-kube-api-access-vl8x4" (OuterVolumeSpecName: "kube-api-access-vl8x4") pod "0220e322-a34e-4f38-9e3e-6112244d995f" (UID: "0220e322-a34e-4f38-9e3e-6112244d995f"). InnerVolumeSpecName "kube-api-access-vl8x4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:26:26.596491 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.596423 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0220e322-a34e-4f38-9e3e-6112244d995f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0220e322-a34e-4f38-9e3e-6112244d995f" (UID: "0220e322-a34e-4f38-9e3e-6112244d995f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:26:26.596491 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.596480 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0220e322-a34e-4f38-9e3e-6112244d995f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0220e322-a34e-4f38-9e3e-6112244d995f" (UID: "0220e322-a34e-4f38-9e3e-6112244d995f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:26:26.695605 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.695571 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0220e322-a34e-4f38-9e3e-6112244d995f-console-oauth-config\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:26.695605 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.695596 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vl8x4\" (UniqueName: \"kubernetes.io/projected/0220e322-a34e-4f38-9e3e-6112244d995f-kube-api-access-vl8x4\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:26.695605 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.695606 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0220e322-a34e-4f38-9e3e-6112244d995f-console-serving-cert\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:26.717042 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.717002 2580 generic.go:356] "Generic (PLEG): container finished" podID="0220e322-a34e-4f38-9e3e-6112244d995f" containerID="8bdbd2f2cadb07805aaac362fee9d25596e0e432a1778746bce28ea1740c7f55" exitCode=0 Jul 10 20:26:26.717197 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.717063 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bfd85ddcf-n4j4t" Jul 10 20:26:26.717197 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.717093 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfd85ddcf-n4j4t" event={"ID":"0220e322-a34e-4f38-9e3e-6112244d995f","Type":"ContainerDied","Data":"8bdbd2f2cadb07805aaac362fee9d25596e0e432a1778746bce28ea1740c7f55"} Jul 10 20:26:26.717197 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.717164 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bfd85ddcf-n4j4t" event={"ID":"0220e322-a34e-4f38-9e3e-6112244d995f","Type":"ContainerDied","Data":"8b825bcfcca32e72e85bec2888d826af320cce8b71a215127bf414c94a10efdc"} Jul 10 20:26:26.717197 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.717186 2580 scope.go:117] "RemoveContainer" containerID="8bdbd2f2cadb07805aaac362fee9d25596e0e432a1778746bce28ea1740c7f55" Jul 10 20:26:26.725612 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.725597 2580 scope.go:117] "RemoveContainer" containerID="8bdbd2f2cadb07805aaac362fee9d25596e0e432a1778746bce28ea1740c7f55" Jul 10 20:26:26.725865 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:26:26.725851 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bdbd2f2cadb07805aaac362fee9d25596e0e432a1778746bce28ea1740c7f55\": container with ID starting with 8bdbd2f2cadb07805aaac362fee9d25596e0e432a1778746bce28ea1740c7f55 not found: ID does not exist" containerID="8bdbd2f2cadb07805aaac362fee9d25596e0e432a1778746bce28ea1740c7f55" Jul 10 20:26:26.725904 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.725874 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bdbd2f2cadb07805aaac362fee9d25596e0e432a1778746bce28ea1740c7f55"} err="failed to get container status \"8bdbd2f2cadb07805aaac362fee9d25596e0e432a1778746bce28ea1740c7f55\": rpc error: code = NotFound desc = could not find container \"8bdbd2f2cadb07805aaac362fee9d25596e0e432a1778746bce28ea1740c7f55\": container with ID starting with 8bdbd2f2cadb07805aaac362fee9d25596e0e432a1778746bce28ea1740c7f55 not found: ID does not exist" Jul 10 20:26:26.737302 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.737277 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bfd85ddcf-n4j4t"] Jul 10 20:26:26.740741 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:26.740721 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bfd85ddcf-n4j4t"] Jul 10 20:26:27.663324 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:27.663295 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0220e322-a34e-4f38-9e3e-6112244d995f" path="/var/lib/kubelet/pods/0220e322-a34e-4f38-9e3e-6112244d995f/volumes" Jul 10 20:26:31.120290 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.120242 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6765b947fd-kmjq6" podUID="753a981b-f047-46c5-b034-10145ec7e361" containerName="console" containerID="cri-o://16a14b7c1a4eee72dd5b394a0cbf3c9a10eeab2c15dc4386817d2583f249f1ec" gracePeriod=15 Jul 10 20:26:31.391418 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.391384 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:26:31.434703 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.434671 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-oauth-serving-cert\") pod \"753a981b-f047-46c5-b034-10145ec7e361\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " Jul 10 20:26:31.434703 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.434714 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-console-config\") pod \"753a981b-f047-46c5-b034-10145ec7e361\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " Jul 10 20:26:31.434959 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.434753 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqbcp\" (UniqueName: \"kubernetes.io/projected/753a981b-f047-46c5-b034-10145ec7e361-kube-api-access-zqbcp\") pod \"753a981b-f047-46c5-b034-10145ec7e361\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " Jul 10 20:26:31.434959 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.434793 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/753a981b-f047-46c5-b034-10145ec7e361-console-serving-cert\") pod \"753a981b-f047-46c5-b034-10145ec7e361\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " Jul 10 20:26:31.434959 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.434811 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-service-ca\") pod \"753a981b-f047-46c5-b034-10145ec7e361\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " Jul 10 20:26:31.434959 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.434838 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/753a981b-f047-46c5-b034-10145ec7e361-console-oauth-config\") pod \"753a981b-f047-46c5-b034-10145ec7e361\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " Jul 10 20:26:31.434959 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.434896 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-trusted-ca-bundle\") pod \"753a981b-f047-46c5-b034-10145ec7e361\" (UID: \"753a981b-f047-46c5-b034-10145ec7e361\") " Jul 10 20:26:31.435490 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.435103 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "753a981b-f047-46c5-b034-10145ec7e361" (UID: "753a981b-f047-46c5-b034-10145ec7e361"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:26:31.435490 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.435219 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-service-ca" (OuterVolumeSpecName: "service-ca") pod "753a981b-f047-46c5-b034-10145ec7e361" (UID: "753a981b-f047-46c5-b034-10145ec7e361"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:26:31.435490 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.435403 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "753a981b-f047-46c5-b034-10145ec7e361" (UID: "753a981b-f047-46c5-b034-10145ec7e361"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:26:31.435647 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.435499 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-console-config" (OuterVolumeSpecName: "console-config") pod "753a981b-f047-46c5-b034-10145ec7e361" (UID: "753a981b-f047-46c5-b034-10145ec7e361"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:26:31.436998 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.436971 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/753a981b-f047-46c5-b034-10145ec7e361-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "753a981b-f047-46c5-b034-10145ec7e361" (UID: "753a981b-f047-46c5-b034-10145ec7e361"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:26:31.437190 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.437170 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/753a981b-f047-46c5-b034-10145ec7e361-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "753a981b-f047-46c5-b034-10145ec7e361" (UID: "753a981b-f047-46c5-b034-10145ec7e361"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:26:31.437306 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.437287 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/753a981b-f047-46c5-b034-10145ec7e361-kube-api-access-zqbcp" (OuterVolumeSpecName: "kube-api-access-zqbcp") pod "753a981b-f047-46c5-b034-10145ec7e361" (UID: "753a981b-f047-46c5-b034-10145ec7e361"). InnerVolumeSpecName "kube-api-access-zqbcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:26:31.535528 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.535496 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-trusted-ca-bundle\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:31.535528 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.535525 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-oauth-serving-cert\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:31.535528 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.535535 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-console-config\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:31.535757 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.535544 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqbcp\" (UniqueName: \"kubernetes.io/projected/753a981b-f047-46c5-b034-10145ec7e361-kube-api-access-zqbcp\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:31.535757 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.535552 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/753a981b-f047-46c5-b034-10145ec7e361-console-serving-cert\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:31.535757 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.535563 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/753a981b-f047-46c5-b034-10145ec7e361-service-ca\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:31.535757 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.535575 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/753a981b-f047-46c5-b034-10145ec7e361-console-oauth-config\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:31.738634 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.738598 2580 generic.go:356] "Generic (PLEG): container finished" podID="753a981b-f047-46c5-b034-10145ec7e361" containerID="16a14b7c1a4eee72dd5b394a0cbf3c9a10eeab2c15dc4386817d2583f249f1ec" exitCode=0 Jul 10 20:26:31.738789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.738640 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6765b947fd-kmjq6" Jul 10 20:26:31.738789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.738635 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6765b947fd-kmjq6" event={"ID":"753a981b-f047-46c5-b034-10145ec7e361","Type":"ContainerDied","Data":"16a14b7c1a4eee72dd5b394a0cbf3c9a10eeab2c15dc4386817d2583f249f1ec"} Jul 10 20:26:31.738789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.738757 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6765b947fd-kmjq6" event={"ID":"753a981b-f047-46c5-b034-10145ec7e361","Type":"ContainerDied","Data":"24597e506f88ae4c6561b14f38462b2050570a42a5d06c33edb871b6b19571ad"} Jul 10 20:26:31.738789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.738777 2580 scope.go:117] "RemoveContainer" containerID="16a14b7c1a4eee72dd5b394a0cbf3c9a10eeab2c15dc4386817d2583f249f1ec" Jul 10 20:26:31.747009 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.746988 2580 scope.go:117] "RemoveContainer" containerID="16a14b7c1a4eee72dd5b394a0cbf3c9a10eeab2c15dc4386817d2583f249f1ec" Jul 10 20:26:31.747279 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:26:31.747260 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16a14b7c1a4eee72dd5b394a0cbf3c9a10eeab2c15dc4386817d2583f249f1ec\": container with ID starting with 16a14b7c1a4eee72dd5b394a0cbf3c9a10eeab2c15dc4386817d2583f249f1ec not found: ID does not exist" containerID="16a14b7c1a4eee72dd5b394a0cbf3c9a10eeab2c15dc4386817d2583f249f1ec" Jul 10 20:26:31.747350 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.747287 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16a14b7c1a4eee72dd5b394a0cbf3c9a10eeab2c15dc4386817d2583f249f1ec"} err="failed to get container status \"16a14b7c1a4eee72dd5b394a0cbf3c9a10eeab2c15dc4386817d2583f249f1ec\": rpc error: code = NotFound desc = could not find container \"16a14b7c1a4eee72dd5b394a0cbf3c9a10eeab2c15dc4386817d2583f249f1ec\": container with ID starting with 16a14b7c1a4eee72dd5b394a0cbf3c9a10eeab2c15dc4386817d2583f249f1ec not found: ID does not exist" Jul 10 20:26:31.755162 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.755125 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6765b947fd-kmjq6"] Jul 10 20:26:31.757744 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:31.757724 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6765b947fd-kmjq6"] Jul 10 20:26:33.659980 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:33.659951 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="753a981b-f047-46c5-b034-10145ec7e361" path="/var/lib/kubelet/pods/753a981b-f047-46c5-b034-10145ec7e361/volumes" Jul 10 20:26:38.575195 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:38.575169 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tq429_e4c479fa-abe8-4123-a651-449f41f51e85/node-ca/0.log" Jul 10 20:26:38.768514 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:38.768480 2580 generic.go:356] "Generic (PLEG): container finished" podID="7b80f7f0-7211-4304-8c64-fbb1a5981c73" containerID="8c8736b239a258ff61e961803b85ac249b6441dc2a0e3b7c00a6ef37518bd420" exitCode=0 Jul 10 20:26:38.768675 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:38.768555 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9" event={"ID":"7b80f7f0-7211-4304-8c64-fbb1a5981c73","Type":"ContainerDied","Data":"8c8736b239a258ff61e961803b85ac249b6441dc2a0e3b7c00a6ef37518bd420"} Jul 10 20:26:38.768901 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:38.768887 2580 scope.go:117] "RemoveContainer" containerID="8c8736b239a258ff61e961803b85ac249b6441dc2a0e3b7c00a6ef37518bd420" Jul 10 20:26:39.376196 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:39.376168 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-scdn6_f14f7f56-76e3-419f-8465-2f708f109e31/serve-healthcheck-canary/0.log" Jul 10 20:26:39.774836 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:39.774753 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-l4hl9" event={"ID":"7b80f7f0-7211-4304-8c64-fbb1a5981c73","Type":"ContainerStarted","Data":"bacab2ada67098b55043cb1c2045560969f4263ac891b37522c7cfa033d1300b"} Jul 10 20:26:51.543355 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.543315 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7869446888-7wrbp" podUID="419f5e16-a704-438a-99ce-454f94442fac" containerName="console" containerID="cri-o://98e41ee1a51993ae99edcc41aad0bde09392f6ecf4fb6775edba0685fd0682c1" gracePeriod=15 Jul 10 20:26:51.607600 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.607562 2580 patch_prober.go:28] interesting pod/console-7869446888-7wrbp container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" start-of-body= Jul 10 20:26:51.607785 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.607626 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-7869446888-7wrbp" podUID="419f5e16-a704-438a-99ce-454f94442fac" containerName="console" probeResult="failure" output="Get \"https://10.133.0.23:8443/health\": dial tcp 10.133.0.23:8443: connect: connection refused" Jul 10 20:26:51.826638 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.826611 2580 generic.go:356] "Generic (PLEG): container finished" podID="419f5e16-a704-438a-99ce-454f94442fac" containerID="98e41ee1a51993ae99edcc41aad0bde09392f6ecf4fb6775edba0685fd0682c1" exitCode=0 Jul 10 20:26:51.826753 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.826679 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7869446888-7wrbp" event={"ID":"419f5e16-a704-438a-99ce-454f94442fac","Type":"ContainerDied","Data":"98e41ee1a51993ae99edcc41aad0bde09392f6ecf4fb6775edba0685fd0682c1"} Jul 10 20:26:51.826753 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.826728 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7869446888-7wrbp" event={"ID":"419f5e16-a704-438a-99ce-454f94442fac","Type":"ContainerDied","Data":"0c2174fa227bafe1538a381537497893902a8d463df0320c520cc37f1c0dd7e0"} Jul 10 20:26:51.826753 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.826749 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c2174fa227bafe1538a381537497893902a8d463df0320c520cc37f1c0dd7e0" Jul 10 20:26:51.832472 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.832453 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:51.919648 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.918409 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/419f5e16-a704-438a-99ce-454f94442fac-console-serving-cert\") pod \"419f5e16-a704-438a-99ce-454f94442fac\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " Jul 10 20:26:51.919648 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.918471 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/419f5e16-a704-438a-99ce-454f94442fac-console-oauth-config\") pod \"419f5e16-a704-438a-99ce-454f94442fac\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " Jul 10 20:26:51.919648 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.918522 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-console-config\") pod \"419f5e16-a704-438a-99ce-454f94442fac\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " Jul 10 20:26:51.919648 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.918554 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-oauth-serving-cert\") pod \"419f5e16-a704-438a-99ce-454f94442fac\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " Jul 10 20:26:51.919648 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.918592 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-trusted-ca-bundle\") pod \"419f5e16-a704-438a-99ce-454f94442fac\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " Jul 10 20:26:51.919648 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.918634 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v447x\" (UniqueName: \"kubernetes.io/projected/419f5e16-a704-438a-99ce-454f94442fac-kube-api-access-v447x\") pod \"419f5e16-a704-438a-99ce-454f94442fac\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " Jul 10 20:26:51.919648 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.918694 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-service-ca\") pod \"419f5e16-a704-438a-99ce-454f94442fac\" (UID: \"419f5e16-a704-438a-99ce-454f94442fac\") " Jul 10 20:26:51.919648 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.919305 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-service-ca" (OuterVolumeSpecName: "service-ca") pod "419f5e16-a704-438a-99ce-454f94442fac" (UID: "419f5e16-a704-438a-99ce-454f94442fac"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:26:51.920886 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.920630 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "419f5e16-a704-438a-99ce-454f94442fac" (UID: "419f5e16-a704-438a-99ce-454f94442fac"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:26:51.921783 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.921525 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-console-config" (OuterVolumeSpecName: "console-config") pod "419f5e16-a704-438a-99ce-454f94442fac" (UID: "419f5e16-a704-438a-99ce-454f94442fac"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:26:51.922076 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.922039 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "419f5e16-a704-438a-99ce-454f94442fac" (UID: "419f5e16-a704-438a-99ce-454f94442fac"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:26:51.930513 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.930487 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/419f5e16-a704-438a-99ce-454f94442fac-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "419f5e16-a704-438a-99ce-454f94442fac" (UID: "419f5e16-a704-438a-99ce-454f94442fac"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:26:51.930639 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.930500 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/419f5e16-a704-438a-99ce-454f94442fac-kube-api-access-v447x" (OuterVolumeSpecName: "kube-api-access-v447x") pod "419f5e16-a704-438a-99ce-454f94442fac" (UID: "419f5e16-a704-438a-99ce-454f94442fac"). InnerVolumeSpecName "kube-api-access-v447x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:26:51.930868 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:51.930848 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/419f5e16-a704-438a-99ce-454f94442fac-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "419f5e16-a704-438a-99ce-454f94442fac" (UID: "419f5e16-a704-438a-99ce-454f94442fac"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:26:52.020512 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:52.020469 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/419f5e16-a704-438a-99ce-454f94442fac-console-serving-cert\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:52.020512 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:52.020514 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/419f5e16-a704-438a-99ce-454f94442fac-console-oauth-config\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:52.020770 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:52.020530 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-console-config\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:52.020770 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:52.020546 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-oauth-serving-cert\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:52.020770 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:52.020560 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-trusted-ca-bundle\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:52.020770 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:52.020576 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v447x\" (UniqueName: \"kubernetes.io/projected/419f5e16-a704-438a-99ce-454f94442fac-kube-api-access-v447x\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:52.020770 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:52.020589 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/419f5e16-a704-438a-99ce-454f94442fac-service-ca\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:26:52.831362 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:52.831280 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7869446888-7wrbp" Jul 10 20:26:52.850023 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:52.849967 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7869446888-7wrbp"] Jul 10 20:26:52.853443 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:52.853421 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7869446888-7wrbp"] Jul 10 20:26:53.659575 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:26:53.659547 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="419f5e16-a704-438a-99ce-454f94442fac" path="/var/lib/kubelet/pods/419f5e16-a704-438a-99ce-454f94442fac/volumes" Jul 10 20:27:16.775734 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:16.775701 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 20:27:16.776250 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:16.775985 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="alertmanager" containerID="cri-o://c84d38da53d4767351effefe521338bd79755854f0487bc27266daa542ebf92d" gracePeriod=120 Jul 10 20:27:16.776250 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:16.776045 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="kube-rbac-proxy-metric" containerID="cri-o://7bdbce9339cc48e21e011bf78d44993b40806a3cb098089c3311c91936cf7db7" gracePeriod=120 Jul 10 20:27:16.776250 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:16.776102 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="config-reloader" containerID="cri-o://dc8d59f93593e2e7ef302eb6efb6aa933485bc34241e21b2928f7ef74a6e576f" gracePeriod=120 Jul 10 20:27:16.776250 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:16.776121 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="prom-label-proxy" containerID="cri-o://55081569ba6512e3c100a6d8f536daaa5396031087440df47e782c7eb931f449" gracePeriod=120 Jul 10 20:27:16.776250 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:16.776082 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="kube-rbac-proxy-web" containerID="cri-o://d99a0545f7c3ca53dab6aeb096101db10f6861b6e01a766d30009cd4d8779a90" gracePeriod=120 Jul 10 20:27:16.776250 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:16.776086 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="kube-rbac-proxy" containerID="cri-o://f1fd72768d99e052c0b1cd51d88bb9bf9b4034e02b481f73282a3ca9b9824974" gracePeriod=120 Jul 10 20:27:16.934404 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:16.934372 2580 generic.go:356] "Generic (PLEG): container finished" podID="47746ee2-2e13-4494-8892-3853327945ab" containerID="55081569ba6512e3c100a6d8f536daaa5396031087440df47e782c7eb931f449" exitCode=0 Jul 10 20:27:16.934404 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:16.934396 2580 generic.go:356] "Generic (PLEG): container finished" podID="47746ee2-2e13-4494-8892-3853327945ab" containerID="7bdbce9339cc48e21e011bf78d44993b40806a3cb098089c3311c91936cf7db7" exitCode=0 Jul 10 20:27:16.934404 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:16.934403 2580 generic.go:356] "Generic (PLEG): container finished" podID="47746ee2-2e13-4494-8892-3853327945ab" containerID="f1fd72768d99e052c0b1cd51d88bb9bf9b4034e02b481f73282a3ca9b9824974" exitCode=0 Jul 10 20:27:16.934404 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:16.934409 2580 generic.go:356] "Generic (PLEG): container finished" podID="47746ee2-2e13-4494-8892-3853327945ab" containerID="dc8d59f93593e2e7ef302eb6efb6aa933485bc34241e21b2928f7ef74a6e576f" exitCode=0 Jul 10 20:27:16.934651 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:16.934415 2580 generic.go:356] "Generic (PLEG): container finished" podID="47746ee2-2e13-4494-8892-3853327945ab" containerID="c84d38da53d4767351effefe521338bd79755854f0487bc27266daa542ebf92d" exitCode=0 Jul 10 20:27:16.934651 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:16.934433 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47746ee2-2e13-4494-8892-3853327945ab","Type":"ContainerDied","Data":"55081569ba6512e3c100a6d8f536daaa5396031087440df47e782c7eb931f449"} Jul 10 20:27:16.934651 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:16.934483 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47746ee2-2e13-4494-8892-3853327945ab","Type":"ContainerDied","Data":"7bdbce9339cc48e21e011bf78d44993b40806a3cb098089c3311c91936cf7db7"} Jul 10 20:27:16.934651 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:16.934508 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47746ee2-2e13-4494-8892-3853327945ab","Type":"ContainerDied","Data":"f1fd72768d99e052c0b1cd51d88bb9bf9b4034e02b481f73282a3ca9b9824974"} Jul 10 20:27:16.934651 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:16.934535 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47746ee2-2e13-4494-8892-3853327945ab","Type":"ContainerDied","Data":"dc8d59f93593e2e7ef302eb6efb6aa933485bc34241e21b2928f7ef74a6e576f"} Jul 10 20:27:16.934651 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:16.934558 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47746ee2-2e13-4494-8892-3853327945ab","Type":"ContainerDied","Data":"c84d38da53d4767351effefe521338bd79755854f0487bc27266daa542ebf92d"} Jul 10 20:27:17.943255 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:17.943106 2580 generic.go:356] "Generic (PLEG): container finished" podID="47746ee2-2e13-4494-8892-3853327945ab" containerID="d99a0545f7c3ca53dab6aeb096101db10f6861b6e01a766d30009cd4d8779a90" exitCode=0 Jul 10 20:27:17.943255 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:17.943168 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47746ee2-2e13-4494-8892-3853327945ab","Type":"ContainerDied","Data":"d99a0545f7c3ca53dab6aeb096101db10f6861b6e01a766d30009cd4d8779a90"} Jul 10 20:27:18.020626 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.020602 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:18.127890 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.127863 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47746ee2-2e13-4494-8892-3853327945ab-alertmanager-trusted-ca-bundle\") pod \"47746ee2-2e13-4494-8892-3853327945ab\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " Jul 10 20:27:18.128055 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.127898 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/47746ee2-2e13-4494-8892-3853327945ab-alertmanager-main-db\") pod \"47746ee2-2e13-4494-8892-3853327945ab\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " Jul 10 20:27:18.128055 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.127918 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-config-volume\") pod \"47746ee2-2e13-4494-8892-3853327945ab\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " Jul 10 20:27:18.128055 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.127936 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47746ee2-2e13-4494-8892-3853327945ab-tls-assets\") pod \"47746ee2-2e13-4494-8892-3853327945ab\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " Jul 10 20:27:18.128055 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.127960 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy-web\") pod \"47746ee2-2e13-4494-8892-3853327945ab\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " Jul 10 20:27:18.128055 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.127981 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy-metric\") pod \"47746ee2-2e13-4494-8892-3853327945ab\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " Jul 10 20:27:18.128345 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.128072 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-web-config\") pod \"47746ee2-2e13-4494-8892-3853327945ab\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " Jul 10 20:27:18.128345 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.128104 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy\") pod \"47746ee2-2e13-4494-8892-3853327945ab\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " Jul 10 20:27:18.128345 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.128163 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47746ee2-2e13-4494-8892-3853327945ab-metrics-client-ca\") pod \"47746ee2-2e13-4494-8892-3853327945ab\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " Jul 10 20:27:18.128345 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.128215 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsvl5\" (UniqueName: \"kubernetes.io/projected/47746ee2-2e13-4494-8892-3853327945ab-kube-api-access-tsvl5\") pod \"47746ee2-2e13-4494-8892-3853327945ab\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " Jul 10 20:27:18.128345 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.128278 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47746ee2-2e13-4494-8892-3853327945ab-config-out\") pod \"47746ee2-2e13-4494-8892-3853327945ab\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " Jul 10 20:27:18.128345 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.128321 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-cluster-tls-config\") pod \"47746ee2-2e13-4494-8892-3853327945ab\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " Jul 10 20:27:18.128345 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.128322 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47746ee2-2e13-4494-8892-3853327945ab-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "47746ee2-2e13-4494-8892-3853327945ab" (UID: "47746ee2-2e13-4494-8892-3853327945ab"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:27:18.128679 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.128358 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-main-tls\") pod \"47746ee2-2e13-4494-8892-3853327945ab\" (UID: \"47746ee2-2e13-4494-8892-3853327945ab\") " Jul 10 20:27:18.128679 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.128394 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47746ee2-2e13-4494-8892-3853327945ab-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "47746ee2-2e13-4494-8892-3853327945ab" (UID: "47746ee2-2e13-4494-8892-3853327945ab"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:27:18.128679 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.128600 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47746ee2-2e13-4494-8892-3853327945ab-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:27:18.128679 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.128619 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/47746ee2-2e13-4494-8892-3853327945ab-alertmanager-main-db\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:27:18.128679 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.128669 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47746ee2-2e13-4494-8892-3853327945ab-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "47746ee2-2e13-4494-8892-3853327945ab" (UID: "47746ee2-2e13-4494-8892-3853327945ab"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:27:18.131592 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.131554 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47746ee2-2e13-4494-8892-3853327945ab-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "47746ee2-2e13-4494-8892-3853327945ab" (UID: "47746ee2-2e13-4494-8892-3853327945ab"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:27:18.131708 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.131606 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47746ee2-2e13-4494-8892-3853327945ab-kube-api-access-tsvl5" (OuterVolumeSpecName: "kube-api-access-tsvl5") pod "47746ee2-2e13-4494-8892-3853327945ab" (UID: "47746ee2-2e13-4494-8892-3853327945ab"). InnerVolumeSpecName "kube-api-access-tsvl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:27:18.131708 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.131662 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "47746ee2-2e13-4494-8892-3853327945ab" (UID: "47746ee2-2e13-4494-8892-3853327945ab"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:27:18.131827 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.131705 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-config-volume" (OuterVolumeSpecName: "config-volume") pod "47746ee2-2e13-4494-8892-3853327945ab" (UID: "47746ee2-2e13-4494-8892-3853327945ab"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:27:18.131827 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.131773 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "47746ee2-2e13-4494-8892-3853327945ab" (UID: "47746ee2-2e13-4494-8892-3853327945ab"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:27:18.132243 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.132219 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "47746ee2-2e13-4494-8892-3853327945ab" (UID: "47746ee2-2e13-4494-8892-3853327945ab"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:27:18.132335 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.132236 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "47746ee2-2e13-4494-8892-3853327945ab" (UID: "47746ee2-2e13-4494-8892-3853327945ab"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:27:18.132335 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.132314 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/47746ee2-2e13-4494-8892-3853327945ab-config-out" (OuterVolumeSpecName: "config-out") pod "47746ee2-2e13-4494-8892-3853327945ab" (UID: "47746ee2-2e13-4494-8892-3853327945ab"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:27:18.135290 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.135265 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "47746ee2-2e13-4494-8892-3853327945ab" (UID: "47746ee2-2e13-4494-8892-3853327945ab"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:27:18.141463 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.141437 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-web-config" (OuterVolumeSpecName: "web-config") pod "47746ee2-2e13-4494-8892-3853327945ab" (UID: "47746ee2-2e13-4494-8892-3853327945ab"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:27:18.229862 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.229820 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-web-config\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:27:18.229862 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.229854 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:27:18.229862 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.229864 2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47746ee2-2e13-4494-8892-3853327945ab-metrics-client-ca\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:27:18.230082 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.229873 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsvl5\" (UniqueName: \"kubernetes.io/projected/47746ee2-2e13-4494-8892-3853327945ab-kube-api-access-tsvl5\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:27:18.230082 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.229883 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/47746ee2-2e13-4494-8892-3853327945ab-config-out\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:27:18.230082 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.229891 2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-cluster-tls-config\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:27:18.230082 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.229901 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-main-tls\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:27:18.230082 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.229910 2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-config-volume\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:27:18.230082 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.229919 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/47746ee2-2e13-4494-8892-3853327945ab-tls-assets\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:27:18.230082 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.229927 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:27:18.230082 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.229935 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/47746ee2-2e13-4494-8892-3853327945ab-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:27:18.950374 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.950339 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"47746ee2-2e13-4494-8892-3853327945ab","Type":"ContainerDied","Data":"9a36af949fb0366860a01a7e371904ce488e0a73b80f75dbc2684189ceda618b"} Jul 10 20:27:18.950769 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.950418 2580 scope.go:117] "RemoveContainer" containerID="55081569ba6512e3c100a6d8f536daaa5396031087440df47e782c7eb931f449" Jul 10 20:27:18.950769 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.950418 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:18.959299 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.959273 2580 scope.go:117] "RemoveContainer" containerID="7bdbce9339cc48e21e011bf78d44993b40806a3cb098089c3311c91936cf7db7" Jul 10 20:27:18.966086 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.966067 2580 scope.go:117] "RemoveContainer" containerID="f1fd72768d99e052c0b1cd51d88bb9bf9b4034e02b481f73282a3ca9b9824974" Jul 10 20:27:18.973008 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.972987 2580 scope.go:117] "RemoveContainer" containerID="d99a0545f7c3ca53dab6aeb096101db10f6861b6e01a766d30009cd4d8779a90" Jul 10 20:27:18.975027 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.975007 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 20:27:18.978957 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.978936 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 20:27:18.980551 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.980535 2580 scope.go:117] "RemoveContainer" containerID="dc8d59f93593e2e7ef302eb6efb6aa933485bc34241e21b2928f7ef74a6e576f" Jul 10 20:27:18.987460 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.987445 2580 scope.go:117] "RemoveContainer" containerID="c84d38da53d4767351effefe521338bd79755854f0487bc27266daa542ebf92d" Jul 10 20:27:18.994600 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:18.994581 2580 scope.go:117] "RemoveContainer" containerID="9e43c80005244cfc89bddf546361ea326618305f04a856268afd28f692e67f7a" Jul 10 20:27:19.003878 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.003540 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 20:27:19.003950 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.003933 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="419f5e16-a704-438a-99ce-454f94442fac" containerName="console" Jul 10 20:27:19.004009 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.003949 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="419f5e16-a704-438a-99ce-454f94442fac" containerName="console" Jul 10 20:27:19.004009 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.003963 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="prom-label-proxy" Jul 10 20:27:19.004009 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.003972 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="prom-label-proxy" Jul 10 20:27:19.004009 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.003988 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="kube-rbac-proxy-web" Jul 10 20:27:19.004009 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.003998 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="kube-rbac-proxy-web" Jul 10 20:27:19.004009 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004009 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="kube-rbac-proxy" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004017 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="kube-rbac-proxy" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004032 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="alertmanager" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004041 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="alertmanager" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004053 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="init-config-reloader" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004062 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="init-config-reloader" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004075 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="kube-rbac-proxy-metric" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004084 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="kube-rbac-proxy-metric" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004097 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="753a981b-f047-46c5-b034-10145ec7e361" containerName="console" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004105 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="753a981b-f047-46c5-b034-10145ec7e361" containerName="console" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004118 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0220e322-a34e-4f38-9e3e-6112244d995f" containerName="console" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004174 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0220e322-a34e-4f38-9e3e-6112244d995f" containerName="console" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004193 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="config-reloader" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004202 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="config-reloader" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004277 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="config-reloader" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004289 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="kube-rbac-proxy-metric" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004298 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="prom-label-proxy" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004306 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0220e322-a34e-4f38-9e3e-6112244d995f" containerName="console" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004315 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="alertmanager" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004326 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="419f5e16-a704-438a-99ce-454f94442fac" containerName="console" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004334 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="kube-rbac-proxy-web" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004342 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="753a981b-f047-46c5-b034-10145ec7e361" containerName="console" Jul 10 20:27:19.004700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.004351 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="47746ee2-2e13-4494-8892-3853327945ab" containerName="kube-rbac-proxy" Jul 10 20:27:19.008716 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.008698 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.011166 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.011146 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 20:27:19.011343 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.011316 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tjzdw\"" Jul 10 20:27:19.011442 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.011407 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 20:27:19.011564 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.011531 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 20:27:19.011564 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.011534 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 20:27:19.011767 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.011748 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 20:27:19.011842 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.011749 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 20:27:19.011907 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.011750 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 20:27:19.011958 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.011905 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 20:27:19.016575 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.016550 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 20:27:19.021712 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.021689 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 20:27:19.136558 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.136527 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.136725 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.136563 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.136725 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.136582 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9hkk\" (UniqueName: \"kubernetes.io/projected/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-kube-api-access-q9hkk\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.136725 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.136615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-web-config\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.136725 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.136642 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.136725 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.136689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.136725 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.136719 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-config-out\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.136927 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.136774 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.136927 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.136811 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.136927 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.136828 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.136927 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.136851 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.136927 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.136904 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-config-volume\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.136927 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.136920 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.237846 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.237813 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.237846 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.237851 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.238069 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.237868 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.238069 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.237995 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.238069 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.238052 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-config-volume\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.238259 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.238080 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.238259 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.238156 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.238259 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.238182 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.238259 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.238209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9hkk\" (UniqueName: \"kubernetes.io/projected/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-kube-api-access-q9hkk\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.238259 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.238251 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-web-config\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.238498 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.238274 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.238498 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.238307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.238498 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.238359 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-config-out\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.238653 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.238547 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.241007 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.240953 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-config-out\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.241007 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.240957 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.241007 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.240958 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.241278 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.240958 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.241278 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.241239 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-config-volume\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.241417 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.241390 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.241583 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.241559 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-web-config\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.241706 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.241684 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.241859 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.241839 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.241859 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.241850 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.242936 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.242920 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.248615 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.248590 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9hkk\" (UniqueName: \"kubernetes.io/projected/94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa-kube-api-access-q9hkk\") pod \"alertmanager-main-0\" (UID: \"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.318277 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.318227 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 20:27:19.469551 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.469506 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 20:27:19.472591 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:27:19.472563 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a17eb9_c2de_4bbe_b1e9_dbe2d8c389aa.slice/crio-dc2eeb396c40934df845d46292dfcc7bdad7da0b5d955165e371d2c19f702564 WatchSource:0}: Error finding container dc2eeb396c40934df845d46292dfcc7bdad7da0b5d955165e371d2c19f702564: Status 404 returned error can't find the container with id dc2eeb396c40934df845d46292dfcc7bdad7da0b5d955165e371d2c19f702564 Jul 10 20:27:19.659361 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.659332 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47746ee2-2e13-4494-8892-3853327945ab" path="/var/lib/kubelet/pods/47746ee2-2e13-4494-8892-3853327945ab/volumes" Jul 10 20:27:19.955714 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.955681 2580 generic.go:356] "Generic (PLEG): container finished" podID="94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa" containerID="cbed6a4e72a0ac8be71e34faf2be64bad4ebb1436318bd2836fad87b5ddcdabb" exitCode=0 Jul 10 20:27:19.956086 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.955773 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa","Type":"ContainerDied","Data":"cbed6a4e72a0ac8be71e34faf2be64bad4ebb1436318bd2836fad87b5ddcdabb"} Jul 10 20:27:19.956086 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:19.955849 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa","Type":"ContainerStarted","Data":"dc2eeb396c40934df845d46292dfcc7bdad7da0b5d955165e371d2c19f702564"} Jul 10 20:27:20.963385 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:20.963350 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa","Type":"ContainerStarted","Data":"fdad26298dbf8fe9fe07fb75f4abb7bba69f9ab6f504167dde92093ca8fccb3b"} Jul 10 20:27:20.963774 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:20.963445 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa","Type":"ContainerStarted","Data":"9c14ab0121c1e0ec337c7015ccd889529fc3fbb6024b79ed69dc234185644586"} Jul 10 20:27:20.963774 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:20.963477 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa","Type":"ContainerStarted","Data":"ad650712957ce0329a5862ecb64c86edb1a58aa9c67d2337b059fd4c0f45843d"} Jul 10 20:27:20.963774 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:20.963500 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa","Type":"ContainerStarted","Data":"8c20380415852534e160328e3e2fb610f12aec0fadcfcc7b6b3619a21d7af481"} Jul 10 20:27:20.963774 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:20.963523 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa","Type":"ContainerStarted","Data":"07c86235f0d315044db084ec7fa882ccf0924db4309e313fb10e3b34adc46aaa"} Jul 10 20:27:20.963774 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:20.963544 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa","Type":"ContainerStarted","Data":"d14d8c7b39b4ef044c7d978266365d911df6bc1fe4d121f9d63f9ba754cfd4c8"} Jul 10 20:27:20.989201 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:20.989028 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.977040036 podStartE2EDuration="2.989010835s" totalImagesPullingTime="0s" totalInitContainerRuntime="11.970799ms" isStatefulPod=false podCreationTimestamp="2026-07-10 20:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:27:20.987755718 +0000 UTC m=+362.447960544" watchObservedRunningTime="2026-07-10 20:27:20.989010835 +0000 UTC m=+362.449215664" Jul 10 20:27:27.755082 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.755045 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55ccb47ccd-9gxcz"] Jul 10 20:27:27.757521 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.757503 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.777612 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.777585 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55ccb47ccd-9gxcz"] Jul 10 20:27:27.822057 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.822030 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-oauth-serving-cert\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.822057 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.822061 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-config\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.822306 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.822090 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-oauth-config\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.822306 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.822284 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p42lr\" (UniqueName: \"kubernetes.io/projected/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-kube-api-access-p42lr\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.822413 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.822338 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-serving-cert\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.822413 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.822369 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-trusted-ca-bundle\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.822413 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.822401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-service-ca\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.923545 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.923508 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-oauth-serving-cert\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.923545 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.923549 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-config\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.923787 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.923587 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-oauth-config\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.923787 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.923640 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p42lr\" (UniqueName: \"kubernetes.io/projected/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-kube-api-access-p42lr\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.923896 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.923847 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-serving-cert\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.923896 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.923883 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-trusted-ca-bundle\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.923997 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.923912 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-service-ca\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.924367 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.924336 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-oauth-serving-cert\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.924367 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.924348 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-config\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.924563 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.924509 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-service-ca\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.924708 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.924688 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-trusted-ca-bundle\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.926533 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.926510 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-serving-cert\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.926608 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.926515 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-oauth-config\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:27.933071 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:27.933049 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p42lr\" (UniqueName: \"kubernetes.io/projected/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-kube-api-access-p42lr\") pod \"console-55ccb47ccd-9gxcz\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:28.066416 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:28.066334 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:28.196331 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:28.196270 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55ccb47ccd-9gxcz"] Jul 10 20:27:28.199007 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:27:28.198984 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f45e97c_c7ca_49da_9e9c_07d4a0887bb6.slice/crio-e0ea06d1d404f0a5d1f5620311eeb164adc85f3130c0f296452baa4918cbf7a3 WatchSource:0}: Error finding container e0ea06d1d404f0a5d1f5620311eeb164adc85f3130c0f296452baa4918cbf7a3: Status 404 returned error can't find the container with id e0ea06d1d404f0a5d1f5620311eeb164adc85f3130c0f296452baa4918cbf7a3 Jul 10 20:27:28.996092 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:28.996054 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55ccb47ccd-9gxcz" event={"ID":"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6","Type":"ContainerStarted","Data":"2ce9b96bb43244cf8b5fb487f3d43f3154e72247b96ed7683bf7bf7bbec64006"} Jul 10 20:27:28.996589 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:28.996114 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55ccb47ccd-9gxcz" event={"ID":"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6","Type":"ContainerStarted","Data":"e0ea06d1d404f0a5d1f5620311eeb164adc85f3130c0f296452baa4918cbf7a3"} Jul 10 20:27:29.012810 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:29.012758 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55ccb47ccd-9gxcz" podStartSLOduration=2.012744474 podStartE2EDuration="2.012744474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:27:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:27:29.011197852 +0000 UTC m=+370.471402680" watchObservedRunningTime="2026-07-10 20:27:29.012744474 +0000 UTC m=+370.472949301" Jul 10 20:27:38.067453 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:38.067416 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:38.067842 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:38.067507 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:38.072443 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:38.072422 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:39.039668 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:39.039636 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:27:39.082680 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:27:39.082650 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5467db77bd-6vz7d"] Jul 10 20:28:04.103233 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.103168 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5467db77bd-6vz7d" podUID="492b53ed-21d6-4b3c-877e-fd7efbad4d73" containerName="console" containerID="cri-o://c5d3088fc9fe135ff6873c16484789083f78a0a0c33e42fbcb059fadfad83be3" gracePeriod=15 Jul 10 20:28:04.343568 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.343535 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:28:04.420741 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.420692 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-service-ca\") pod \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " Jul 10 20:28:04.420741 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.420748 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g272t\" (UniqueName: \"kubernetes.io/projected/492b53ed-21d6-4b3c-877e-fd7efbad4d73-kube-api-access-g272t\") pod \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " Jul 10 20:28:04.421010 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.420798 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-trusted-ca-bundle\") pod \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " Jul 10 20:28:04.421010 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.420825 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-config\") pod \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " Jul 10 20:28:04.421010 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.420852 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-oauth-serving-cert\") pod \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " Jul 10 20:28:04.421010 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.420878 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-oauth-config\") pod \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " Jul 10 20:28:04.421010 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.420930 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-serving-cert\") pod \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\" (UID: \"492b53ed-21d6-4b3c-877e-fd7efbad4d73\") " Jul 10 20:28:04.421259 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.421154 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-service-ca" (OuterVolumeSpecName: "service-ca") pod "492b53ed-21d6-4b3c-877e-fd7efbad4d73" (UID: "492b53ed-21d6-4b3c-877e-fd7efbad4d73"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:28:04.421329 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.421302 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-config" (OuterVolumeSpecName: "console-config") pod "492b53ed-21d6-4b3c-877e-fd7efbad4d73" (UID: "492b53ed-21d6-4b3c-877e-fd7efbad4d73"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:28:04.421442 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.421311 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "492b53ed-21d6-4b3c-877e-fd7efbad4d73" (UID: "492b53ed-21d6-4b3c-877e-fd7efbad4d73"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:28:04.421572 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.421486 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "492b53ed-21d6-4b3c-877e-fd7efbad4d73" (UID: "492b53ed-21d6-4b3c-877e-fd7efbad4d73"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:28:04.423018 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.422995 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "492b53ed-21d6-4b3c-877e-fd7efbad4d73" (UID: "492b53ed-21d6-4b3c-877e-fd7efbad4d73"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:28:04.423089 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.423037 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "492b53ed-21d6-4b3c-877e-fd7efbad4d73" (UID: "492b53ed-21d6-4b3c-877e-fd7efbad4d73"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:28:04.423140 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.423081 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/492b53ed-21d6-4b3c-877e-fd7efbad4d73-kube-api-access-g272t" (OuterVolumeSpecName: "kube-api-access-g272t") pod "492b53ed-21d6-4b3c-877e-fd7efbad4d73" (UID: "492b53ed-21d6-4b3c-877e-fd7efbad4d73"). InnerVolumeSpecName "kube-api-access-g272t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:28:04.521803 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.521749 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-trusted-ca-bundle\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:28:04.521803 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.521795 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-config\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:28:04.521803 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.521805 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-oauth-serving-cert\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:28:04.521803 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.521815 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-oauth-config\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:28:04.521803 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.521824 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/492b53ed-21d6-4b3c-877e-fd7efbad4d73-console-serving-cert\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:28:04.522107 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.521832 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/492b53ed-21d6-4b3c-877e-fd7efbad4d73-service-ca\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:28:04.522107 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:04.521840 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g272t\" (UniqueName: \"kubernetes.io/projected/492b53ed-21d6-4b3c-877e-fd7efbad4d73-kube-api-access-g272t\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:28:05.138557 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:05.138526 2580 generic.go:356] "Generic (PLEG): container finished" podID="492b53ed-21d6-4b3c-877e-fd7efbad4d73" containerID="c5d3088fc9fe135ff6873c16484789083f78a0a0c33e42fbcb059fadfad83be3" exitCode=0 Jul 10 20:28:05.138948 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:05.138567 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5467db77bd-6vz7d" event={"ID":"492b53ed-21d6-4b3c-877e-fd7efbad4d73","Type":"ContainerDied","Data":"c5d3088fc9fe135ff6873c16484789083f78a0a0c33e42fbcb059fadfad83be3"} Jul 10 20:28:05.138948 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:05.138573 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5467db77bd-6vz7d" Jul 10 20:28:05.138948 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:05.138606 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5467db77bd-6vz7d" event={"ID":"492b53ed-21d6-4b3c-877e-fd7efbad4d73","Type":"ContainerDied","Data":"4f285dc9cb895ff45729ce70c7767ab6994d719ddd50b8e05b4bb7b022c614e6"} Jul 10 20:28:05.138948 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:05.138628 2580 scope.go:117] "RemoveContainer" containerID="c5d3088fc9fe135ff6873c16484789083f78a0a0c33e42fbcb059fadfad83be3" Jul 10 20:28:05.147702 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:05.147685 2580 scope.go:117] "RemoveContainer" containerID="c5d3088fc9fe135ff6873c16484789083f78a0a0c33e42fbcb059fadfad83be3" Jul 10 20:28:05.147950 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:28:05.147927 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5d3088fc9fe135ff6873c16484789083f78a0a0c33e42fbcb059fadfad83be3\": container with ID starting with c5d3088fc9fe135ff6873c16484789083f78a0a0c33e42fbcb059fadfad83be3 not found: ID does not exist" containerID="c5d3088fc9fe135ff6873c16484789083f78a0a0c33e42fbcb059fadfad83be3" Jul 10 20:28:05.148015 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:05.147956 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5d3088fc9fe135ff6873c16484789083f78a0a0c33e42fbcb059fadfad83be3"} err="failed to get container status \"c5d3088fc9fe135ff6873c16484789083f78a0a0c33e42fbcb059fadfad83be3\": rpc error: code = NotFound desc = could not find container \"c5d3088fc9fe135ff6873c16484789083f78a0a0c33e42fbcb059fadfad83be3\": container with ID starting with c5d3088fc9fe135ff6873c16484789083f78a0a0c33e42fbcb059fadfad83be3 not found: ID does not exist" Jul 10 20:28:05.159496 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:05.159469 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5467db77bd-6vz7d"] Jul 10 20:28:05.162391 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:05.162368 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5467db77bd-6vz7d"] Jul 10 20:28:05.660076 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:05.660046 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="492b53ed-21d6-4b3c-877e-fd7efbad4d73" path="/var/lib/kubelet/pods/492b53ed-21d6-4b3c-877e-fd7efbad4d73/volumes" Jul 10 20:28:16.585423 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.585383 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr"] Jul 10 20:28:16.585788 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.585701 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="492b53ed-21d6-4b3c-877e-fd7efbad4d73" containerName="console" Jul 10 20:28:16.585788 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.585712 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="492b53ed-21d6-4b3c-877e-fd7efbad4d73" containerName="console" Jul 10 20:28:16.585788 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.585762 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="492b53ed-21d6-4b3c-877e-fd7efbad4d73" containerName="console" Jul 10 20:28:16.587742 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.587726 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" Jul 10 20:28:16.590289 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.590271 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 20:28:16.590398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.590273 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-td9xj\"" Jul 10 20:28:16.590398 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.590276 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 20:28:16.600976 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.600947 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr"] Jul 10 20:28:16.613853 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.613824 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m977h\" (UniqueName: \"kubernetes.io/projected/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-kube-api-access-m977h\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr\" (UID: \"ee956c08-7a4c-40cd-80b6-d7cf93cfec27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" Jul 10 20:28:16.613992 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.613885 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr\" (UID: \"ee956c08-7a4c-40cd-80b6-d7cf93cfec27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" Jul 10 20:28:16.613992 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.613963 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr\" (UID: \"ee956c08-7a4c-40cd-80b6-d7cf93cfec27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" Jul 10 20:28:16.714721 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.714680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m977h\" (UniqueName: \"kubernetes.io/projected/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-kube-api-access-m977h\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr\" (UID: \"ee956c08-7a4c-40cd-80b6-d7cf93cfec27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" Jul 10 20:28:16.714923 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.714772 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr\" (UID: \"ee956c08-7a4c-40cd-80b6-d7cf93cfec27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" Jul 10 20:28:16.714923 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.714821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr\" (UID: \"ee956c08-7a4c-40cd-80b6-d7cf93cfec27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" Jul 10 20:28:16.715194 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.715152 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr\" (UID: \"ee956c08-7a4c-40cd-80b6-d7cf93cfec27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" Jul 10 20:28:16.715273 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.715206 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr\" (UID: \"ee956c08-7a4c-40cd-80b6-d7cf93cfec27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" Jul 10 20:28:16.723257 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.723238 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m977h\" (UniqueName: \"kubernetes.io/projected/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-kube-api-access-m977h\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr\" (UID: \"ee956c08-7a4c-40cd-80b6-d7cf93cfec27\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" Jul 10 20:28:16.896345 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:16.896307 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" Jul 10 20:28:17.026925 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:17.026893 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr"] Jul 10 20:28:17.030247 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:28:17.030223 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee956c08_7a4c_40cd_80b6_d7cf93cfec27.slice/crio-f3559424291c02b220b6e6b8aad5fd37210238f7ce69c02fc8084d63abb58630 WatchSource:0}: Error finding container f3559424291c02b220b6e6b8aad5fd37210238f7ce69c02fc8084d63abb58630: Status 404 returned error can't find the container with id f3559424291c02b220b6e6b8aad5fd37210238f7ce69c02fc8084d63abb58630 Jul 10 20:28:17.032062 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:17.032041 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 20:28:17.186917 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:17.186832 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" event={"ID":"ee956c08-7a4c-40cd-80b6-d7cf93cfec27","Type":"ContainerStarted","Data":"f3559424291c02b220b6e6b8aad5fd37210238f7ce69c02fc8084d63abb58630"} Jul 10 20:28:24.223775 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:24.223740 2580 generic.go:356] "Generic (PLEG): container finished" podID="ee956c08-7a4c-40cd-80b6-d7cf93cfec27" containerID="9073a46aba1c82f4ccf1e5bfd14829892d056a910de23a9b676aa804ea8521ab" exitCode=0 Jul 10 20:28:24.224260 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:24.223817 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" event={"ID":"ee956c08-7a4c-40cd-80b6-d7cf93cfec27","Type":"ContainerDied","Data":"9073a46aba1c82f4ccf1e5bfd14829892d056a910de23a9b676aa804ea8521ab"} Jul 10 20:28:27.238167 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:27.238062 2580 generic.go:356] "Generic (PLEG): container finished" podID="ee956c08-7a4c-40cd-80b6-d7cf93cfec27" containerID="97b5a4bb24cadcc0524aeaa9a2b667d004c0113a7d156a6135914fb5377c6420" exitCode=0 Jul 10 20:28:27.238167 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:27.238152 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" event={"ID":"ee956c08-7a4c-40cd-80b6-d7cf93cfec27","Type":"ContainerDied","Data":"97b5a4bb24cadcc0524aeaa9a2b667d004c0113a7d156a6135914fb5377c6420"} Jul 10 20:28:35.275502 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:35.275464 2580 generic.go:356] "Generic (PLEG): container finished" podID="ee956c08-7a4c-40cd-80b6-d7cf93cfec27" containerID="a3868fa53529c2fcbd15953a265b6f41ff335ddcb7b37712440e47788114624a" exitCode=0 Jul 10 20:28:35.276008 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:35.275539 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" event={"ID":"ee956c08-7a4c-40cd-80b6-d7cf93cfec27","Type":"ContainerDied","Data":"a3868fa53529c2fcbd15953a265b6f41ff335ddcb7b37712440e47788114624a"} Jul 10 20:28:36.446122 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:36.446091 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" Jul 10 20:28:36.587365 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:36.587268 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-bundle\") pod \"ee956c08-7a4c-40cd-80b6-d7cf93cfec27\" (UID: \"ee956c08-7a4c-40cd-80b6-d7cf93cfec27\") " Jul 10 20:28:36.587365 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:36.587320 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-util\") pod \"ee956c08-7a4c-40cd-80b6-d7cf93cfec27\" (UID: \"ee956c08-7a4c-40cd-80b6-d7cf93cfec27\") " Jul 10 20:28:36.587365 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:36.587347 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m977h\" (UniqueName: \"kubernetes.io/projected/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-kube-api-access-m977h\") pod \"ee956c08-7a4c-40cd-80b6-d7cf93cfec27\" (UID: \"ee956c08-7a4c-40cd-80b6-d7cf93cfec27\") " Jul 10 20:28:36.587987 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:36.587963 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-bundle" (OuterVolumeSpecName: "bundle") pod "ee956c08-7a4c-40cd-80b6-d7cf93cfec27" (UID: "ee956c08-7a4c-40cd-80b6-d7cf93cfec27"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:28:36.589520 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:36.589493 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-kube-api-access-m977h" (OuterVolumeSpecName: "kube-api-access-m977h") pod "ee956c08-7a4c-40cd-80b6-d7cf93cfec27" (UID: "ee956c08-7a4c-40cd-80b6-d7cf93cfec27"). InnerVolumeSpecName "kube-api-access-m977h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:28:36.592156 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:36.592120 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-util" (OuterVolumeSpecName: "util") pod "ee956c08-7a4c-40cd-80b6-d7cf93cfec27" (UID: "ee956c08-7a4c-40cd-80b6-d7cf93cfec27"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:28:36.688718 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:36.688681 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-util\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:28:36.688718 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:36.688714 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m977h\" (UniqueName: \"kubernetes.io/projected/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-kube-api-access-m977h\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:28:36.688718 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:36.688725 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee956c08-7a4c-40cd-80b6-d7cf93cfec27-bundle\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:28:37.285308 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:37.285273 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" event={"ID":"ee956c08-7a4c-40cd-80b6-d7cf93cfec27","Type":"ContainerDied","Data":"f3559424291c02b220b6e6b8aad5fd37210238f7ce69c02fc8084d63abb58630"} Jul 10 20:28:37.285491 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:37.285322 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3559424291c02b220b6e6b8aad5fd37210238f7ce69c02fc8084d63abb58630" Jul 10 20:28:37.285491 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:37.285285 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540n5zgr" Jul 10 20:28:44.571542 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.571468 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-22877"] Jul 10 20:28:44.571892 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.571808 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee956c08-7a4c-40cd-80b6-d7cf93cfec27" containerName="pull" Jul 10 20:28:44.571892 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.571821 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee956c08-7a4c-40cd-80b6-d7cf93cfec27" containerName="pull" Jul 10 20:28:44.571892 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.571832 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee956c08-7a4c-40cd-80b6-d7cf93cfec27" containerName="util" Jul 10 20:28:44.571892 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.571838 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee956c08-7a4c-40cd-80b6-d7cf93cfec27" containerName="util" Jul 10 20:28:44.571892 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.571860 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee956c08-7a4c-40cd-80b6-d7cf93cfec27" containerName="extract" Jul 10 20:28:44.571892 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.571865 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee956c08-7a4c-40cd-80b6-d7cf93cfec27" containerName="extract" Jul 10 20:28:44.572075 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.571912 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee956c08-7a4c-40cd-80b6-d7cf93cfec27" containerName="extract" Jul 10 20:28:44.573704 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.573689 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-22877" Jul 10 20:28:44.576257 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.576233 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-t6dt6\"" Jul 10 20:28:44.576552 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.576536 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 10 20:28:44.576731 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.576720 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 10 20:28:44.588026 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.588003 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-22877"] Jul 10 20:28:44.655110 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.655079 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p7m9\" (UniqueName: \"kubernetes.io/projected/27136aca-fac9-462a-983a-d24881d3045c-kube-api-access-7p7m9\") pod \"cert-manager-operator-controller-manager-55c444bf86-22877\" (UID: \"27136aca-fac9-462a-983a-d24881d3045c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-22877" Jul 10 20:28:44.655293 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.655173 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27136aca-fac9-462a-983a-d24881d3045c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-22877\" (UID: \"27136aca-fac9-462a-983a-d24881d3045c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-22877" Jul 10 20:28:44.755683 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.755654 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p7m9\" (UniqueName: \"kubernetes.io/projected/27136aca-fac9-462a-983a-d24881d3045c-kube-api-access-7p7m9\") pod \"cert-manager-operator-controller-manager-55c444bf86-22877\" (UID: \"27136aca-fac9-462a-983a-d24881d3045c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-22877" Jul 10 20:28:44.755904 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.755875 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27136aca-fac9-462a-983a-d24881d3045c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-22877\" (UID: \"27136aca-fac9-462a-983a-d24881d3045c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-22877" Jul 10 20:28:44.756336 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.756310 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/27136aca-fac9-462a-983a-d24881d3045c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-22877\" (UID: \"27136aca-fac9-462a-983a-d24881d3045c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-22877" Jul 10 20:28:44.764960 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.764935 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p7m9\" (UniqueName: \"kubernetes.io/projected/27136aca-fac9-462a-983a-d24881d3045c-kube-api-access-7p7m9\") pod \"cert-manager-operator-controller-manager-55c444bf86-22877\" (UID: \"27136aca-fac9-462a-983a-d24881d3045c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-22877" Jul 10 20:28:44.882317 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:44.882287 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-22877" Jul 10 20:28:45.014952 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:45.014917 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-22877"] Jul 10 20:28:45.019582 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:28:45.019555 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27136aca_fac9_462a_983a_d24881d3045c.slice/crio-7ea32ba26fe57db86f1a698a2f8f799c304edb36b010fa6951027899101641ed WatchSource:0}: Error finding container 7ea32ba26fe57db86f1a698a2f8f799c304edb36b010fa6951027899101641ed: Status 404 returned error can't find the container with id 7ea32ba26fe57db86f1a698a2f8f799c304edb36b010fa6951027899101641ed Jul 10 20:28:45.319256 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:45.319165 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-22877" event={"ID":"27136aca-fac9-462a-983a-d24881d3045c","Type":"ContainerStarted","Data":"7ea32ba26fe57db86f1a698a2f8f799c304edb36b010fa6951027899101641ed"} Jul 10 20:28:47.329940 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:47.329897 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-22877" event={"ID":"27136aca-fac9-462a-983a-d24881d3045c","Type":"ContainerStarted","Data":"95280b4d2ab2a04a22fd73d29e24980ef0860f91f4f52ecf344b9816caa801e4"} Jul 10 20:28:47.351758 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:47.351713 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-22877" podStartSLOduration=1.740438632 podStartE2EDuration="3.351697448s" totalImagesPullingTime="1.611258816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:28:47.349456525 +0000 UTC m=+448.809661351" watchObservedRunningTime="2026-07-10 20:28:47.351697448 +0000 UTC m=+448.811902273" Jul 10 20:28:48.389483 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.389446 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj"] Jul 10 20:28:48.391834 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.391817 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" Jul 10 20:28:48.394293 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.394268 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 20:28:48.395085 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.395068 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-td9xj\"" Jul 10 20:28:48.395192 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.395105 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 20:28:48.402146 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.402107 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj"] Jul 10 20:28:48.486254 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.486217 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a0e75a8-7eac-447a-9491-335a228a6b31-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj\" (UID: \"7a0e75a8-7eac-447a-9491-335a228a6b31\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" Jul 10 20:28:48.486424 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.486336 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a0e75a8-7eac-447a-9491-335a228a6b31-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj\" (UID: \"7a0e75a8-7eac-447a-9491-335a228a6b31\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" Jul 10 20:28:48.486424 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.486383 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfpmh\" (UniqueName: \"kubernetes.io/projected/7a0e75a8-7eac-447a-9491-335a228a6b31-kube-api-access-nfpmh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj\" (UID: \"7a0e75a8-7eac-447a-9491-335a228a6b31\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" Jul 10 20:28:48.587328 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.587288 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a0e75a8-7eac-447a-9491-335a228a6b31-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj\" (UID: \"7a0e75a8-7eac-447a-9491-335a228a6b31\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" Jul 10 20:28:48.587528 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.587369 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a0e75a8-7eac-447a-9491-335a228a6b31-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj\" (UID: \"7a0e75a8-7eac-447a-9491-335a228a6b31\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" Jul 10 20:28:48.587528 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.587418 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfpmh\" (UniqueName: \"kubernetes.io/projected/7a0e75a8-7eac-447a-9491-335a228a6b31-kube-api-access-nfpmh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj\" (UID: \"7a0e75a8-7eac-447a-9491-335a228a6b31\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" Jul 10 20:28:48.587719 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.587696 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a0e75a8-7eac-447a-9491-335a228a6b31-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj\" (UID: \"7a0e75a8-7eac-447a-9491-335a228a6b31\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" Jul 10 20:28:48.587773 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.587737 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a0e75a8-7eac-447a-9491-335a228a6b31-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj\" (UID: \"7a0e75a8-7eac-447a-9491-335a228a6b31\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" Jul 10 20:28:48.599312 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.599289 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfpmh\" (UniqueName: \"kubernetes.io/projected/7a0e75a8-7eac-447a-9491-335a228a6b31-kube-api-access-nfpmh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj\" (UID: \"7a0e75a8-7eac-447a-9491-335a228a6b31\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" Jul 10 20:28:48.681204 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.681109 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-t2nfs"] Jul 10 20:28:48.683576 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.683557 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-t2nfs" Jul 10 20:28:48.686205 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.686187 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 10 20:28:48.686432 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.686415 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-b49pc\"" Jul 10 20:28:48.686655 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.686640 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 10 20:28:48.694094 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.694072 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-t2nfs"] Jul 10 20:28:48.701458 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.701434 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" Jul 10 20:28:48.788691 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.788661 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7q8v\" (UniqueName: \"kubernetes.io/projected/ac587eff-329f-4ccf-9c65-66ad81183a70-kube-api-access-s7q8v\") pod \"cert-manager-webhook-6486ffd997-t2nfs\" (UID: \"ac587eff-329f-4ccf-9c65-66ad81183a70\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t2nfs" Jul 10 20:28:48.788846 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.788706 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac587eff-329f-4ccf-9c65-66ad81183a70-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-t2nfs\" (UID: \"ac587eff-329f-4ccf-9c65-66ad81183a70\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t2nfs" Jul 10 20:28:48.833576 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.833552 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj"] Jul 10 20:28:48.835399 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:28:48.835368 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a0e75a8_7eac_447a_9491_335a228a6b31.slice/crio-df5fe60959c3825c7b945eeed9f0e8a044f700efacf6a84686f5e475a3899090 WatchSource:0}: Error finding container df5fe60959c3825c7b945eeed9f0e8a044f700efacf6a84686f5e475a3899090: Status 404 returned error can't find the container with id df5fe60959c3825c7b945eeed9f0e8a044f700efacf6a84686f5e475a3899090 Jul 10 20:28:48.889061 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.889027 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac587eff-329f-4ccf-9c65-66ad81183a70-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-t2nfs\" (UID: \"ac587eff-329f-4ccf-9c65-66ad81183a70\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t2nfs" Jul 10 20:28:48.889221 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.889104 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7q8v\" (UniqueName: \"kubernetes.io/projected/ac587eff-329f-4ccf-9c65-66ad81183a70-kube-api-access-s7q8v\") pod \"cert-manager-webhook-6486ffd997-t2nfs\" (UID: \"ac587eff-329f-4ccf-9c65-66ad81183a70\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t2nfs" Jul 10 20:28:48.899618 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.899588 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac587eff-329f-4ccf-9c65-66ad81183a70-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-t2nfs\" (UID: \"ac587eff-329f-4ccf-9c65-66ad81183a70\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t2nfs" Jul 10 20:28:48.900019 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:48.899998 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7q8v\" (UniqueName: \"kubernetes.io/projected/ac587eff-329f-4ccf-9c65-66ad81183a70-kube-api-access-s7q8v\") pod \"cert-manager-webhook-6486ffd997-t2nfs\" (UID: \"ac587eff-329f-4ccf-9c65-66ad81183a70\") " pod="cert-manager/cert-manager-webhook-6486ffd997-t2nfs" Jul 10 20:28:49.011100 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:49.011062 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-t2nfs" Jul 10 20:28:49.137107 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:49.136943 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-t2nfs"] Jul 10 20:28:49.139171 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:28:49.139147 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac587eff_329f_4ccf_9c65_66ad81183a70.slice/crio-da7fa12d2a13a33f490a898d59fd14446f27a8910ea8dd8556576147bb27c35f WatchSource:0}: Error finding container da7fa12d2a13a33f490a898d59fd14446f27a8910ea8dd8556576147bb27c35f: Status 404 returned error can't find the container with id da7fa12d2a13a33f490a898d59fd14446f27a8910ea8dd8556576147bb27c35f Jul 10 20:28:49.340033 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:49.339940 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-t2nfs" event={"ID":"ac587eff-329f-4ccf-9c65-66ad81183a70","Type":"ContainerStarted","Data":"da7fa12d2a13a33f490a898d59fd14446f27a8910ea8dd8556576147bb27c35f"} Jul 10 20:28:49.341388 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:49.341366 2580 generic.go:356] "Generic (PLEG): container finished" podID="7a0e75a8-7eac-447a-9491-335a228a6b31" containerID="61ae64ea224ea894d58afb24d945624546a2b5e6b2812aedfd11f80452cb973f" exitCode=0 Jul 10 20:28:49.341493 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:49.341453 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" event={"ID":"7a0e75a8-7eac-447a-9491-335a228a6b31","Type":"ContainerDied","Data":"61ae64ea224ea894d58afb24d945624546a2b5e6b2812aedfd11f80452cb973f"} Jul 10 20:28:49.341545 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:49.341501 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" event={"ID":"7a0e75a8-7eac-447a-9491-335a228a6b31","Type":"ContainerStarted","Data":"df5fe60959c3825c7b945eeed9f0e8a044f700efacf6a84686f5e475a3899090"} Jul 10 20:28:50.979115 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:50.979072 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cnjkf"] Jul 10 20:28:50.983956 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:50.983932 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cnjkf" Jul 10 20:28:50.986597 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:50.986569 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-44trp\"" Jul 10 20:28:50.992196 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:50.991642 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cnjkf"] Jul 10 20:28:51.108647 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:51.108608 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rmh2\" (UniqueName: \"kubernetes.io/projected/74dadc5a-be99-457f-9ca0-8a2800545a46-kube-api-access-9rmh2\") pod \"cert-manager-cainjector-559cdd8c87-cnjkf\" (UID: \"74dadc5a-be99-457f-9ca0-8a2800545a46\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cnjkf" Jul 10 20:28:51.108823 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:51.108655 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74dadc5a-be99-457f-9ca0-8a2800545a46-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cnjkf\" (UID: \"74dadc5a-be99-457f-9ca0-8a2800545a46\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cnjkf" Jul 10 20:28:51.209981 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:51.209942 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rmh2\" (UniqueName: \"kubernetes.io/projected/74dadc5a-be99-457f-9ca0-8a2800545a46-kube-api-access-9rmh2\") pod \"cert-manager-cainjector-559cdd8c87-cnjkf\" (UID: \"74dadc5a-be99-457f-9ca0-8a2800545a46\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cnjkf" Jul 10 20:28:51.210181 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:51.209991 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74dadc5a-be99-457f-9ca0-8a2800545a46-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cnjkf\" (UID: \"74dadc5a-be99-457f-9ca0-8a2800545a46\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cnjkf" Jul 10 20:28:51.218333 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:51.218300 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74dadc5a-be99-457f-9ca0-8a2800545a46-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-cnjkf\" (UID: \"74dadc5a-be99-457f-9ca0-8a2800545a46\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cnjkf" Jul 10 20:28:51.218559 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:51.218533 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rmh2\" (UniqueName: \"kubernetes.io/projected/74dadc5a-be99-457f-9ca0-8a2800545a46-kube-api-access-9rmh2\") pod \"cert-manager-cainjector-559cdd8c87-cnjkf\" (UID: \"74dadc5a-be99-457f-9ca0-8a2800545a46\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-cnjkf" Jul 10 20:28:51.297392 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:51.297309 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cnjkf" Jul 10 20:28:52.743584 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:52.743545 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-cnjkf"] Jul 10 20:28:52.747977 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:28:52.747945 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74dadc5a_be99_457f_9ca0_8a2800545a46.slice/crio-681cc6e991132c817296cd4001aed4c042640ee9ce7cff58cbe4ec76bd68006e WatchSource:0}: Error finding container 681cc6e991132c817296cd4001aed4c042640ee9ce7cff58cbe4ec76bd68006e: Status 404 returned error can't find the container with id 681cc6e991132c817296cd4001aed4c042640ee9ce7cff58cbe4ec76bd68006e Jul 10 20:28:53.365469 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:53.365437 2580 generic.go:356] "Generic (PLEG): container finished" podID="7a0e75a8-7eac-447a-9491-335a228a6b31" containerID="434c3bb35da784c91eead8cd0cdef5c2270e3fd057b31c326fb1566389ef9096" exitCode=0 Jul 10 20:28:53.365643 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:53.365537 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" event={"ID":"7a0e75a8-7eac-447a-9491-335a228a6b31","Type":"ContainerDied","Data":"434c3bb35da784c91eead8cd0cdef5c2270e3fd057b31c326fb1566389ef9096"} Jul 10 20:28:53.367230 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:53.367204 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-t2nfs" event={"ID":"ac587eff-329f-4ccf-9c65-66ad81183a70","Type":"ContainerStarted","Data":"4c1b857f0995cdf7cf5e6d120bbddf9c0ed48009e64cdacef57d7a9c05864ac9"} Jul 10 20:28:53.367339 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:53.367319 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-t2nfs" Jul 10 20:28:53.368615 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:53.368595 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cnjkf" event={"ID":"74dadc5a-be99-457f-9ca0-8a2800545a46","Type":"ContainerStarted","Data":"d2c26cf181f611c03352958c95f19bf8d361b5de702fcffb7b97c2c5c439f8ff"} Jul 10 20:28:53.368683 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:53.368624 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cnjkf" event={"ID":"74dadc5a-be99-457f-9ca0-8a2800545a46","Type":"ContainerStarted","Data":"681cc6e991132c817296cd4001aed4c042640ee9ce7cff58cbe4ec76bd68006e"} Jul 10 20:28:53.396831 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:53.396782 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-t2nfs" podStartSLOduration=1.929808678 podStartE2EDuration="5.396765493s" totalImagesPullingTime="3.466956815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:28:53.395785426 +0000 UTC m=+454.855990252" watchObservedRunningTime="2026-07-10 20:28:53.396765493 +0000 UTC m=+454.856970318" Jul 10 20:28:53.412517 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:53.412476 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-cnjkf" podStartSLOduration=3.412460609 podStartE2EDuration="3.412460609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:28:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:28:53.411314503 +0000 UTC m=+454.871519329" watchObservedRunningTime="2026-07-10 20:28:53.412460609 +0000 UTC m=+454.872665434" Jul 10 20:28:54.375093 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:54.375059 2580 generic.go:356] "Generic (PLEG): container finished" podID="7a0e75a8-7eac-447a-9491-335a228a6b31" containerID="ff03c48f5a238a83bbc5d1d6dc98b952adef98fe841c1b2dab97cdaeea73d026" exitCode=0 Jul 10 20:28:54.375586 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:54.375167 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" event={"ID":"7a0e75a8-7eac-447a-9491-335a228a6b31","Type":"ContainerDied","Data":"ff03c48f5a238a83bbc5d1d6dc98b952adef98fe841c1b2dab97cdaeea73d026"} Jul 10 20:28:55.514072 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:55.514047 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" Jul 10 20:28:55.647565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:55.647477 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfpmh\" (UniqueName: \"kubernetes.io/projected/7a0e75a8-7eac-447a-9491-335a228a6b31-kube-api-access-nfpmh\") pod \"7a0e75a8-7eac-447a-9491-335a228a6b31\" (UID: \"7a0e75a8-7eac-447a-9491-335a228a6b31\") " Jul 10 20:28:55.647565 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:55.647536 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a0e75a8-7eac-447a-9491-335a228a6b31-bundle\") pod \"7a0e75a8-7eac-447a-9491-335a228a6b31\" (UID: \"7a0e75a8-7eac-447a-9491-335a228a6b31\") " Jul 10 20:28:55.647791 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:55.647587 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a0e75a8-7eac-447a-9491-335a228a6b31-util\") pod \"7a0e75a8-7eac-447a-9491-335a228a6b31\" (UID: \"7a0e75a8-7eac-447a-9491-335a228a6b31\") " Jul 10 20:28:55.648004 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:55.647981 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a0e75a8-7eac-447a-9491-335a228a6b31-bundle" (OuterVolumeSpecName: "bundle") pod "7a0e75a8-7eac-447a-9491-335a228a6b31" (UID: "7a0e75a8-7eac-447a-9491-335a228a6b31"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:28:55.649606 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:55.649582 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a0e75a8-7eac-447a-9491-335a228a6b31-kube-api-access-nfpmh" (OuterVolumeSpecName: "kube-api-access-nfpmh") pod "7a0e75a8-7eac-447a-9491-335a228a6b31" (UID: "7a0e75a8-7eac-447a-9491-335a228a6b31"). InnerVolumeSpecName "kube-api-access-nfpmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:28:55.654258 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:55.654214 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a0e75a8-7eac-447a-9491-335a228a6b31-util" (OuterVolumeSpecName: "util") pod "7a0e75a8-7eac-447a-9491-335a228a6b31" (UID: "7a0e75a8-7eac-447a-9491-335a228a6b31"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:28:55.748519 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:55.748483 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfpmh\" (UniqueName: \"kubernetes.io/projected/7a0e75a8-7eac-447a-9491-335a228a6b31-kube-api-access-nfpmh\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:28:55.748519 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:55.748514 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a0e75a8-7eac-447a-9491-335a228a6b31-bundle\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:28:55.748519 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:55.748524 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a0e75a8-7eac-447a-9491-335a228a6b31-util\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:28:56.387727 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:56.387682 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" event={"ID":"7a0e75a8-7eac-447a-9491-335a228a6b31","Type":"ContainerDied","Data":"df5fe60959c3825c7b945eeed9f0e8a044f700efacf6a84686f5e475a3899090"} Jul 10 20:28:56.387886 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:56.387731 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5h8kj" Jul 10 20:28:56.387886 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:56.387741 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df5fe60959c3825c7b945eeed9f0e8a044f700efacf6a84686f5e475a3899090" Jul 10 20:28:59.377165 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:28:59.377112 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-t2nfs" Jul 10 20:29:01.339843 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.339798 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mj4pl"] Jul 10 20:29:01.340308 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.340296 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0e75a8-7eac-447a-9491-335a228a6b31" containerName="extract" Jul 10 20:29:01.340386 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.340314 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0e75a8-7eac-447a-9491-335a228a6b31" containerName="extract" Jul 10 20:29:01.340386 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.340335 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0e75a8-7eac-447a-9491-335a228a6b31" containerName="util" Jul 10 20:29:01.340386 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.340344 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0e75a8-7eac-447a-9491-335a228a6b31" containerName="util" Jul 10 20:29:01.340386 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.340355 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0e75a8-7eac-447a-9491-335a228a6b31" containerName="pull" Jul 10 20:29:01.340386 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.340364 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0e75a8-7eac-447a-9491-335a228a6b31" containerName="pull" Jul 10 20:29:01.340617 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.340447 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a0e75a8-7eac-447a-9491-335a228a6b31" containerName="extract" Jul 10 20:29:01.343894 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.343875 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mj4pl" Jul 10 20:29:01.346122 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.346103 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-vcl8b\"" Jul 10 20:29:01.351880 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.351856 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mj4pl"] Jul 10 20:29:01.389066 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.389017 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32caa9c6-268a-4f9d-bea7-dd62a7bfd5f5-bound-sa-token\") pod \"cert-manager-55b4d954d5-mj4pl\" (UID: \"32caa9c6-268a-4f9d-bea7-dd62a7bfd5f5\") " pod="cert-manager/cert-manager-55b4d954d5-mj4pl" Jul 10 20:29:01.389253 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.389094 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txkc6\" (UniqueName: \"kubernetes.io/projected/32caa9c6-268a-4f9d-bea7-dd62a7bfd5f5-kube-api-access-txkc6\") pod \"cert-manager-55b4d954d5-mj4pl\" (UID: \"32caa9c6-268a-4f9d-bea7-dd62a7bfd5f5\") " pod="cert-manager/cert-manager-55b4d954d5-mj4pl" Jul 10 20:29:01.490439 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.490399 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32caa9c6-268a-4f9d-bea7-dd62a7bfd5f5-bound-sa-token\") pod \"cert-manager-55b4d954d5-mj4pl\" (UID: \"32caa9c6-268a-4f9d-bea7-dd62a7bfd5f5\") " pod="cert-manager/cert-manager-55b4d954d5-mj4pl" Jul 10 20:29:01.490439 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.490443 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txkc6\" (UniqueName: \"kubernetes.io/projected/32caa9c6-268a-4f9d-bea7-dd62a7bfd5f5-kube-api-access-txkc6\") pod \"cert-manager-55b4d954d5-mj4pl\" (UID: \"32caa9c6-268a-4f9d-bea7-dd62a7bfd5f5\") " pod="cert-manager/cert-manager-55b4d954d5-mj4pl" Jul 10 20:29:01.499407 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.499380 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32caa9c6-268a-4f9d-bea7-dd62a7bfd5f5-bound-sa-token\") pod \"cert-manager-55b4d954d5-mj4pl\" (UID: \"32caa9c6-268a-4f9d-bea7-dd62a7bfd5f5\") " pod="cert-manager/cert-manager-55b4d954d5-mj4pl" Jul 10 20:29:01.499722 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.499701 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txkc6\" (UniqueName: \"kubernetes.io/projected/32caa9c6-268a-4f9d-bea7-dd62a7bfd5f5-kube-api-access-txkc6\") pod \"cert-manager-55b4d954d5-mj4pl\" (UID: \"32caa9c6-268a-4f9d-bea7-dd62a7bfd5f5\") " pod="cert-manager/cert-manager-55b4d954d5-mj4pl" Jul 10 20:29:01.653242 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.653205 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mj4pl" Jul 10 20:29:01.789408 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:01.789376 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mj4pl"] Jul 10 20:29:01.792222 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:29:01.792196 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32caa9c6_268a_4f9d_bea7_dd62a7bfd5f5.slice/crio-4e73b940abe52c07713ab1c5c0ec75302361a2474171d271f12bf5f8accf757c WatchSource:0}: Error finding container 4e73b940abe52c07713ab1c5c0ec75302361a2474171d271f12bf5f8accf757c: Status 404 returned error can't find the container with id 4e73b940abe52c07713ab1c5c0ec75302361a2474171d271f12bf5f8accf757c Jul 10 20:29:02.416342 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:02.416304 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mj4pl" event={"ID":"32caa9c6-268a-4f9d-bea7-dd62a7bfd5f5","Type":"ContainerStarted","Data":"264748da46cb9daaae808131c2e9761bda35f9169b90e07caaa2116920563e10"} Jul 10 20:29:02.416717 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:02.416350 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mj4pl" event={"ID":"32caa9c6-268a-4f9d-bea7-dd62a7bfd5f5","Type":"ContainerStarted","Data":"4e73b940abe52c07713ab1c5c0ec75302361a2474171d271f12bf5f8accf757c"} Jul 10 20:29:02.431751 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:02.431698 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-mj4pl" podStartSLOduration=1.431681462 podStartE2EDuration="1.431681462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:29:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:29:02.430625075 +0000 UTC m=+463.890829903" watchObservedRunningTime="2026-07-10 20:29:02.431681462 +0000 UTC m=+463.891886287" Jul 10 20:29:12.534227 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:12.534186 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6"] Jul 10 20:29:12.536626 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:12.536610 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" Jul 10 20:29:12.538946 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:12.538921 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 10 20:29:12.539064 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:12.538957 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-td9xj\"" Jul 10 20:29:12.539827 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:12.539808 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 10 20:29:12.545270 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:12.545250 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6"] Jul 10 20:29:12.574117 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:12.574081 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a20d04da-1ebf-4afc-a844-f2d247100654-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6\" (UID: \"a20d04da-1ebf-4afc-a844-f2d247100654\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" Jul 10 20:29:12.574293 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:12.574148 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktx2w\" (UniqueName: \"kubernetes.io/projected/a20d04da-1ebf-4afc-a844-f2d247100654-kube-api-access-ktx2w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6\" (UID: \"a20d04da-1ebf-4afc-a844-f2d247100654\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" Jul 10 20:29:12.574293 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:12.574212 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a20d04da-1ebf-4afc-a844-f2d247100654-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6\" (UID: \"a20d04da-1ebf-4afc-a844-f2d247100654\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" Jul 10 20:29:12.675112 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:12.675075 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a20d04da-1ebf-4afc-a844-f2d247100654-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6\" (UID: \"a20d04da-1ebf-4afc-a844-f2d247100654\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" Jul 10 20:29:12.675317 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:12.675117 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktx2w\" (UniqueName: \"kubernetes.io/projected/a20d04da-1ebf-4afc-a844-f2d247100654-kube-api-access-ktx2w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6\" (UID: \"a20d04da-1ebf-4afc-a844-f2d247100654\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" Jul 10 20:29:12.675317 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:12.675247 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a20d04da-1ebf-4afc-a844-f2d247100654-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6\" (UID: \"a20d04da-1ebf-4afc-a844-f2d247100654\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" Jul 10 20:29:12.675541 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:12.675522 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a20d04da-1ebf-4afc-a844-f2d247100654-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6\" (UID: \"a20d04da-1ebf-4afc-a844-f2d247100654\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" Jul 10 20:29:12.675604 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:12.675583 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a20d04da-1ebf-4afc-a844-f2d247100654-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6\" (UID: \"a20d04da-1ebf-4afc-a844-f2d247100654\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" Jul 10 20:29:12.683844 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:12.683819 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktx2w\" (UniqueName: \"kubernetes.io/projected/a20d04da-1ebf-4afc-a844-f2d247100654-kube-api-access-ktx2w\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6\" (UID: \"a20d04da-1ebf-4afc-a844-f2d247100654\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" Jul 10 20:29:12.846612 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:12.846530 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" Jul 10 20:29:12.977960 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:12.977935 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6"] Jul 10 20:29:12.980703 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:29:12.980678 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20d04da_1ebf_4afc_a844_f2d247100654.slice/crio-2c0de6d9cb17d424b7b88f83b581c6c1b0463a71d29ed2755df88c6ee3655eca WatchSource:0}: Error finding container 2c0de6d9cb17d424b7b88f83b581c6c1b0463a71d29ed2755df88c6ee3655eca: Status 404 returned error can't find the container with id 2c0de6d9cb17d424b7b88f83b581c6c1b0463a71d29ed2755df88c6ee3655eca Jul 10 20:29:13.467667 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:13.467635 2580 generic.go:356] "Generic (PLEG): container finished" podID="a20d04da-1ebf-4afc-a844-f2d247100654" containerID="485ee18b1b1720f52c9f2fe60e6f79d63833cd5a9cebdd936b508cebe2411457" exitCode=0 Jul 10 20:29:13.467852 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:13.467716 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" event={"ID":"a20d04da-1ebf-4afc-a844-f2d247100654","Type":"ContainerDied","Data":"485ee18b1b1720f52c9f2fe60e6f79d63833cd5a9cebdd936b508cebe2411457"} Jul 10 20:29:13.467852 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:13.467761 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" event={"ID":"a20d04da-1ebf-4afc-a844-f2d247100654","Type":"ContainerStarted","Data":"2c0de6d9cb17d424b7b88f83b581c6c1b0463a71d29ed2755df88c6ee3655eca"} Jul 10 20:29:14.473885 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:14.473849 2580 generic.go:356] "Generic (PLEG): container finished" podID="a20d04da-1ebf-4afc-a844-f2d247100654" containerID="7d6361b7104ff06c154d4922af994a14bbb5f13378aa1854e8a4cc7a04751282" exitCode=0 Jul 10 20:29:14.474294 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:14.473938 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" event={"ID":"a20d04da-1ebf-4afc-a844-f2d247100654","Type":"ContainerDied","Data":"7d6361b7104ff06c154d4922af994a14bbb5f13378aa1854e8a4cc7a04751282"} Jul 10 20:29:15.480198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:15.480169 2580 generic.go:356] "Generic (PLEG): container finished" podID="a20d04da-1ebf-4afc-a844-f2d247100654" containerID="b3af4006896dec766948ac5ab77419f27a98980d9c36ce00b322c50e91bba27e" exitCode=0 Jul 10 20:29:15.480576 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:15.480263 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" event={"ID":"a20d04da-1ebf-4afc-a844-f2d247100654","Type":"ContainerDied","Data":"b3af4006896dec766948ac5ab77419f27a98980d9c36ce00b322c50e91bba27e"} Jul 10 20:29:16.611852 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:16.611818 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" Jul 10 20:29:16.712913 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:16.712880 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktx2w\" (UniqueName: \"kubernetes.io/projected/a20d04da-1ebf-4afc-a844-f2d247100654-kube-api-access-ktx2w\") pod \"a20d04da-1ebf-4afc-a844-f2d247100654\" (UID: \"a20d04da-1ebf-4afc-a844-f2d247100654\") " Jul 10 20:29:16.713114 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:16.712949 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a20d04da-1ebf-4afc-a844-f2d247100654-util\") pod \"a20d04da-1ebf-4afc-a844-f2d247100654\" (UID: \"a20d04da-1ebf-4afc-a844-f2d247100654\") " Jul 10 20:29:16.713114 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:16.712971 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a20d04da-1ebf-4afc-a844-f2d247100654-bundle\") pod \"a20d04da-1ebf-4afc-a844-f2d247100654\" (UID: \"a20d04da-1ebf-4afc-a844-f2d247100654\") " Jul 10 20:29:16.713730 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:16.713694 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a20d04da-1ebf-4afc-a844-f2d247100654-bundle" (OuterVolumeSpecName: "bundle") pod "a20d04da-1ebf-4afc-a844-f2d247100654" (UID: "a20d04da-1ebf-4afc-a844-f2d247100654"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:29:16.714968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:16.714939 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a20d04da-1ebf-4afc-a844-f2d247100654-kube-api-access-ktx2w" (OuterVolumeSpecName: "kube-api-access-ktx2w") pod "a20d04da-1ebf-4afc-a844-f2d247100654" (UID: "a20d04da-1ebf-4afc-a844-f2d247100654"). InnerVolumeSpecName "kube-api-access-ktx2w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:29:16.719191 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:16.719168 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a20d04da-1ebf-4afc-a844-f2d247100654-util" (OuterVolumeSpecName: "util") pod "a20d04da-1ebf-4afc-a844-f2d247100654" (UID: "a20d04da-1ebf-4afc-a844-f2d247100654"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:29:16.814104 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:16.814004 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktx2w\" (UniqueName: \"kubernetes.io/projected/a20d04da-1ebf-4afc-a844-f2d247100654-kube-api-access-ktx2w\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:29:16.814104 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:16.814031 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a20d04da-1ebf-4afc-a844-f2d247100654-util\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:29:16.814104 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:16.814041 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a20d04da-1ebf-4afc-a844-f2d247100654-bundle\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:29:17.491685 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:17.491644 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" event={"ID":"a20d04da-1ebf-4afc-a844-f2d247100654","Type":"ContainerDied","Data":"2c0de6d9cb17d424b7b88f83b581c6c1b0463a71d29ed2755df88c6ee3655eca"} Jul 10 20:29:17.491685 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:17.491690 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhr9j6" Jul 10 20:29:17.491893 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:17.491702 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c0de6d9cb17d424b7b88f83b581c6c1b0463a71d29ed2755df88c6ee3655eca" Jul 10 20:29:27.218169 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.218117 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d"] Jul 10 20:29:27.218519 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.218471 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a20d04da-1ebf-4afc-a844-f2d247100654" containerName="util" Jul 10 20:29:27.218519 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.218481 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a20d04da-1ebf-4afc-a844-f2d247100654" containerName="util" Jul 10 20:29:27.218519 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.218490 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a20d04da-1ebf-4afc-a844-f2d247100654" containerName="pull" Jul 10 20:29:27.218519 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.218496 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a20d04da-1ebf-4afc-a844-f2d247100654" containerName="pull" Jul 10 20:29:27.218519 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.218502 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a20d04da-1ebf-4afc-a844-f2d247100654" containerName="extract" Jul 10 20:29:27.218519 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.218508 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a20d04da-1ebf-4afc-a844-f2d247100654" containerName="extract" Jul 10 20:29:27.218715 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.218558 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a20d04da-1ebf-4afc-a844-f2d247100654" containerName="extract" Jul 10 20:29:27.221257 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.221238 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" Jul 10 20:29:27.224457 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.224419 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 20:29:27.224457 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.224427 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 10 20:29:27.224624 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.224488 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-r4c2w\"" Jul 10 20:29:27.224700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.224686 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 20:29:27.224758 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.224717 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 10 20:29:27.224812 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.224722 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 10 20:29:27.232329 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.232307 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d"] Jul 10 20:29:27.299483 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.299451 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f4f5ece-2383-410b-a4ea-b3b4abdfec2d-metrics-cert\") pod \"lws-controller-manager-5dcfcfbc-c8f8d\" (UID: \"7f4f5ece-2383-410b-a4ea-b3b4abdfec2d\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" Jul 10 20:29:27.299669 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.299499 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f4f5ece-2383-410b-a4ea-b3b4abdfec2d-cert\") pod \"lws-controller-manager-5dcfcfbc-c8f8d\" (UID: \"7f4f5ece-2383-410b-a4ea-b3b4abdfec2d\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" Jul 10 20:29:27.299669 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.299585 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7f4f5ece-2383-410b-a4ea-b3b4abdfec2d-manager-config\") pod \"lws-controller-manager-5dcfcfbc-c8f8d\" (UID: \"7f4f5ece-2383-410b-a4ea-b3b4abdfec2d\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" Jul 10 20:29:27.299744 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.299712 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmj2j\" (UniqueName: \"kubernetes.io/projected/7f4f5ece-2383-410b-a4ea-b3b4abdfec2d-kube-api-access-hmj2j\") pod \"lws-controller-manager-5dcfcfbc-c8f8d\" (UID: \"7f4f5ece-2383-410b-a4ea-b3b4abdfec2d\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" Jul 10 20:29:27.400421 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.400381 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f4f5ece-2383-410b-a4ea-b3b4abdfec2d-metrics-cert\") pod \"lws-controller-manager-5dcfcfbc-c8f8d\" (UID: \"7f4f5ece-2383-410b-a4ea-b3b4abdfec2d\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" Jul 10 20:29:27.400421 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.400424 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f4f5ece-2383-410b-a4ea-b3b4abdfec2d-cert\") pod \"lws-controller-manager-5dcfcfbc-c8f8d\" (UID: \"7f4f5ece-2383-410b-a4ea-b3b4abdfec2d\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" Jul 10 20:29:27.400629 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.400475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7f4f5ece-2383-410b-a4ea-b3b4abdfec2d-manager-config\") pod \"lws-controller-manager-5dcfcfbc-c8f8d\" (UID: \"7f4f5ece-2383-410b-a4ea-b3b4abdfec2d\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" Jul 10 20:29:27.400690 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.400640 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmj2j\" (UniqueName: \"kubernetes.io/projected/7f4f5ece-2383-410b-a4ea-b3b4abdfec2d-kube-api-access-hmj2j\") pod \"lws-controller-manager-5dcfcfbc-c8f8d\" (UID: \"7f4f5ece-2383-410b-a4ea-b3b4abdfec2d\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" Jul 10 20:29:27.401212 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.401192 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7f4f5ece-2383-410b-a4ea-b3b4abdfec2d-manager-config\") pod \"lws-controller-manager-5dcfcfbc-c8f8d\" (UID: \"7f4f5ece-2383-410b-a4ea-b3b4abdfec2d\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" Jul 10 20:29:27.402939 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.402919 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f4f5ece-2383-410b-a4ea-b3b4abdfec2d-cert\") pod \"lws-controller-manager-5dcfcfbc-c8f8d\" (UID: \"7f4f5ece-2383-410b-a4ea-b3b4abdfec2d\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" Jul 10 20:29:27.403024 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.402925 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f4f5ece-2383-410b-a4ea-b3b4abdfec2d-metrics-cert\") pod \"lws-controller-manager-5dcfcfbc-c8f8d\" (UID: \"7f4f5ece-2383-410b-a4ea-b3b4abdfec2d\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" Jul 10 20:29:27.408501 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.408484 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmj2j\" (UniqueName: \"kubernetes.io/projected/7f4f5ece-2383-410b-a4ea-b3b4abdfec2d-kube-api-access-hmj2j\") pod \"lws-controller-manager-5dcfcfbc-c8f8d\" (UID: \"7f4f5ece-2383-410b-a4ea-b3b4abdfec2d\") " pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" Jul 10 20:29:27.530242 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.530156 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" Jul 10 20:29:27.667348 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:27.667317 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d"] Jul 10 20:29:27.670792 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:29:27.670763 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f4f5ece_2383_410b_a4ea_b3b4abdfec2d.slice/crio-c16492ab01799a894f7663f0e9dd3c1866c6a514547c1e9aa626ca774ebac4af WatchSource:0}: Error finding container c16492ab01799a894f7663f0e9dd3c1866c6a514547c1e9aa626ca774ebac4af: Status 404 returned error can't find the container with id c16492ab01799a894f7663f0e9dd3c1866c6a514547c1e9aa626ca774ebac4af Jul 10 20:29:28.545199 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:28.545158 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" event={"ID":"7f4f5ece-2383-410b-a4ea-b3b4abdfec2d","Type":"ContainerStarted","Data":"c16492ab01799a894f7663f0e9dd3c1866c6a514547c1e9aa626ca774ebac4af"} Jul 10 20:29:28.968405 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:28.968367 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q"] Jul 10 20:29:28.971114 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:28.971090 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:28.973690 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:28.973668 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 20:29:28.973806 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:28.973737 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 20:29:28.973881 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:28.973811 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zlv5v\"" Jul 10 20:29:28.973881 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:28.973869 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 20:29:28.974104 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:28.974078 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 20:29:28.991632 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:28.991599 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q"] Jul 10 20:29:29.116810 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.116774 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36c35daf-316c-4e7e-b4b0-0022a64e26c6-manifests\") pod \"opendatahub-operator-controller-manager-7b6f977c45-s4x4q\" (UID: \"36c35daf-316c-4e7e-b4b0-0022a64e26c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:29.117012 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.116840 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36c35daf-316c-4e7e-b4b0-0022a64e26c6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b6f977c45-s4x4q\" (UID: \"36c35daf-316c-4e7e-b4b0-0022a64e26c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:29.117012 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.116900 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36c35daf-316c-4e7e-b4b0-0022a64e26c6-tmp\") pod \"opendatahub-operator-controller-manager-7b6f977c45-s4x4q\" (UID: \"36c35daf-316c-4e7e-b4b0-0022a64e26c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:29.117012 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.116927 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36c35daf-316c-4e7e-b4b0-0022a64e26c6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b6f977c45-s4x4q\" (UID: \"36c35daf-316c-4e7e-b4b0-0022a64e26c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:29.117215 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.117007 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mctjn\" (UniqueName: \"kubernetes.io/projected/36c35daf-316c-4e7e-b4b0-0022a64e26c6-kube-api-access-mctjn\") pod \"opendatahub-operator-controller-manager-7b6f977c45-s4x4q\" (UID: \"36c35daf-316c-4e7e-b4b0-0022a64e26c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:29.217691 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.217669 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36c35daf-316c-4e7e-b4b0-0022a64e26c6-tmp\") pod \"opendatahub-operator-controller-manager-7b6f977c45-s4x4q\" (UID: \"36c35daf-316c-4e7e-b4b0-0022a64e26c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:29.217778 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.217701 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36c35daf-316c-4e7e-b4b0-0022a64e26c6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b6f977c45-s4x4q\" (UID: \"36c35daf-316c-4e7e-b4b0-0022a64e26c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:29.217778 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.217735 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mctjn\" (UniqueName: \"kubernetes.io/projected/36c35daf-316c-4e7e-b4b0-0022a64e26c6-kube-api-access-mctjn\") pod \"opendatahub-operator-controller-manager-7b6f977c45-s4x4q\" (UID: \"36c35daf-316c-4e7e-b4b0-0022a64e26c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:29.217888 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.217780 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36c35daf-316c-4e7e-b4b0-0022a64e26c6-manifests\") pod \"opendatahub-operator-controller-manager-7b6f977c45-s4x4q\" (UID: \"36c35daf-316c-4e7e-b4b0-0022a64e26c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:29.217888 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.217814 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36c35daf-316c-4e7e-b4b0-0022a64e26c6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b6f977c45-s4x4q\" (UID: \"36c35daf-316c-4e7e-b4b0-0022a64e26c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:29.218218 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.218191 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36c35daf-316c-4e7e-b4b0-0022a64e26c6-manifests\") pod \"opendatahub-operator-controller-manager-7b6f977c45-s4x4q\" (UID: \"36c35daf-316c-4e7e-b4b0-0022a64e26c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:29.219968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.219911 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36c35daf-316c-4e7e-b4b0-0022a64e26c6-tmp\") pod \"opendatahub-operator-controller-manager-7b6f977c45-s4x4q\" (UID: \"36c35daf-316c-4e7e-b4b0-0022a64e26c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:29.220117 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.220096 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36c35daf-316c-4e7e-b4b0-0022a64e26c6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7b6f977c45-s4x4q\" (UID: \"36c35daf-316c-4e7e-b4b0-0022a64e26c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:29.220197 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.220143 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36c35daf-316c-4e7e-b4b0-0022a64e26c6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7b6f977c45-s4x4q\" (UID: \"36c35daf-316c-4e7e-b4b0-0022a64e26c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:29.226389 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.226370 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mctjn\" (UniqueName: \"kubernetes.io/projected/36c35daf-316c-4e7e-b4b0-0022a64e26c6-kube-api-access-mctjn\") pod \"opendatahub-operator-controller-manager-7b6f977c45-s4x4q\" (UID: \"36c35daf-316c-4e7e-b4b0-0022a64e26c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:29.283080 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.283050 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:29.420509 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.420474 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q"] Jul 10 20:29:29.424226 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:29:29.424199 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c35daf_316c_4e7e_b4b0_0022a64e26c6.slice/crio-9d7bdc45c54678a2cf1eb1f66f6894c5a27971ce18a5bc3c840336455497a598 WatchSource:0}: Error finding container 9d7bdc45c54678a2cf1eb1f66f6894c5a27971ce18a5bc3c840336455497a598: Status 404 returned error can't find the container with id 9d7bdc45c54678a2cf1eb1f66f6894c5a27971ce18a5bc3c840336455497a598 Jul 10 20:29:29.551254 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.551157 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" event={"ID":"36c35daf-316c-4e7e-b4b0-0022a64e26c6","Type":"ContainerStarted","Data":"9d7bdc45c54678a2cf1eb1f66f6894c5a27971ce18a5bc3c840336455497a598"} Jul 10 20:29:29.552665 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.552639 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" event={"ID":"7f4f5ece-2383-410b-a4ea-b3b4abdfec2d","Type":"ContainerStarted","Data":"23896a6ae6e710279be107115980a6f64c4b7b149c0315fbb663f61b60979882"} Jul 10 20:29:29.552791 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.552763 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" Jul 10 20:29:29.572260 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:29.572209 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" podStartSLOduration=1.051407175 podStartE2EDuration="2.572189379s" totalImagesPullingTime="1.520782204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:29:29.571101605 +0000 UTC m=+491.031306433" watchObservedRunningTime="2026-07-10 20:29:29.572189379 +0000 UTC m=+491.032394206" Jul 10 20:29:32.571487 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:32.571448 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" event={"ID":"36c35daf-316c-4e7e-b4b0-0022a64e26c6","Type":"ContainerStarted","Data":"ca8c4cec07803853cb32f9c5ab923fe49c5d1177e848655361c0d4a401b19894"} Jul 10 20:29:33.577719 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:33.577688 2580 generic.go:356] "Generic (PLEG): container finished" podID="36c35daf-316c-4e7e-b4b0-0022a64e26c6" containerID="ca8c4cec07803853cb32f9c5ab923fe49c5d1177e848655361c0d4a401b19894" exitCode=0 Jul 10 20:29:33.578112 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:33.577774 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" event={"ID":"36c35daf-316c-4e7e-b4b0-0022a64e26c6","Type":"ContainerDied","Data":"ca8c4cec07803853cb32f9c5ab923fe49c5d1177e848655361c0d4a401b19894"} Jul 10 20:29:34.585006 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:34.584959 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" event={"ID":"36c35daf-316c-4e7e-b4b0-0022a64e26c6","Type":"ContainerStarted","Data":"1e0e834b06407d0fbdd4f0884fa6acfafc4986ad2fcb37092a6a042fd9942ab5"} Jul 10 20:29:34.585430 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:34.585085 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:34.608690 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:34.608634 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" podStartSLOduration=2.261557325 podStartE2EDuration="6.608619344s" totalImagesPullingTime="3.339805879s" totalInitContainerRuntime="1.00725614s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:29:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:29:34.605836282 +0000 UTC m=+496.066041110" watchObservedRunningTime="2026-07-10 20:29:34.608619344 +0000 UTC m=+496.068824170" Jul 10 20:29:40.561102 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:40.561072 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5dcfcfbc-c8f8d" Jul 10 20:29:45.591755 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:45.591721 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7b6f977c45-s4x4q" Jul 10 20:29:49.339308 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.339277 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b5fcf8fc5-cmdw6"] Jul 10 20:29:49.346755 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.346733 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b5fcf8fc5-cmdw6" Jul 10 20:29:49.349689 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.349665 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 10 20:29:49.349989 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.349971 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 20:29:49.350770 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.350736 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 10 20:29:49.350865 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.350770 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tfrls\"" Jul 10 20:29:49.350865 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.350770 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 20:29:49.366262 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.366235 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b5fcf8fc5-cmdw6"] Jul 10 20:29:49.401178 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.401143 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a97bcd0-37da-4969-a350-9d65007e20e9-tmp\") pod \"kube-auth-proxy-b5fcf8fc5-cmdw6\" (UID: \"2a97bcd0-37da-4969-a350-9d65007e20e9\") " pod="openshift-ingress/kube-auth-proxy-b5fcf8fc5-cmdw6" Jul 10 20:29:49.401178 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.401179 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk7qn\" (UniqueName: \"kubernetes.io/projected/2a97bcd0-37da-4969-a350-9d65007e20e9-kube-api-access-rk7qn\") pod \"kube-auth-proxy-b5fcf8fc5-cmdw6\" (UID: \"2a97bcd0-37da-4969-a350-9d65007e20e9\") " pod="openshift-ingress/kube-auth-proxy-b5fcf8fc5-cmdw6" Jul 10 20:29:49.401377 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.401202 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a97bcd0-37da-4969-a350-9d65007e20e9-tls-certs\") pod \"kube-auth-proxy-b5fcf8fc5-cmdw6\" (UID: \"2a97bcd0-37da-4969-a350-9d65007e20e9\") " pod="openshift-ingress/kube-auth-proxy-b5fcf8fc5-cmdw6" Jul 10 20:29:49.502046 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.502002 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a97bcd0-37da-4969-a350-9d65007e20e9-tmp\") pod \"kube-auth-proxy-b5fcf8fc5-cmdw6\" (UID: \"2a97bcd0-37da-4969-a350-9d65007e20e9\") " pod="openshift-ingress/kube-auth-proxy-b5fcf8fc5-cmdw6" Jul 10 20:29:49.502046 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.502049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk7qn\" (UniqueName: \"kubernetes.io/projected/2a97bcd0-37da-4969-a350-9d65007e20e9-kube-api-access-rk7qn\") pod \"kube-auth-proxy-b5fcf8fc5-cmdw6\" (UID: \"2a97bcd0-37da-4969-a350-9d65007e20e9\") " pod="openshift-ingress/kube-auth-proxy-b5fcf8fc5-cmdw6" Jul 10 20:29:49.502321 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.502077 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a97bcd0-37da-4969-a350-9d65007e20e9-tls-certs\") pod \"kube-auth-proxy-b5fcf8fc5-cmdw6\" (UID: \"2a97bcd0-37da-4969-a350-9d65007e20e9\") " pod="openshift-ingress/kube-auth-proxy-b5fcf8fc5-cmdw6" Jul 10 20:29:49.504516 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.504490 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a97bcd0-37da-4969-a350-9d65007e20e9-tmp\") pod \"kube-auth-proxy-b5fcf8fc5-cmdw6\" (UID: \"2a97bcd0-37da-4969-a350-9d65007e20e9\") " pod="openshift-ingress/kube-auth-proxy-b5fcf8fc5-cmdw6" Jul 10 20:29:49.504762 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.504732 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2a97bcd0-37da-4969-a350-9d65007e20e9-tls-certs\") pod \"kube-auth-proxy-b5fcf8fc5-cmdw6\" (UID: \"2a97bcd0-37da-4969-a350-9d65007e20e9\") " pod="openshift-ingress/kube-auth-proxy-b5fcf8fc5-cmdw6" Jul 10 20:29:49.517835 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.517775 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk7qn\" (UniqueName: \"kubernetes.io/projected/2a97bcd0-37da-4969-a350-9d65007e20e9-kube-api-access-rk7qn\") pod \"kube-auth-proxy-b5fcf8fc5-cmdw6\" (UID: \"2a97bcd0-37da-4969-a350-9d65007e20e9\") " pod="openshift-ingress/kube-auth-proxy-b5fcf8fc5-cmdw6" Jul 10 20:29:49.656004 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.655976 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b5fcf8fc5-cmdw6" Jul 10 20:29:49.812646 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:49.812614 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b5fcf8fc5-cmdw6"] Jul 10 20:29:49.815579 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:29:49.815553 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a97bcd0_37da_4969_a350_9d65007e20e9.slice/crio-238d7d25960f819ac06bfc2209ead67a0376a3cf17ece767dcaf1ac1f1eeb732 WatchSource:0}: Error finding container 238d7d25960f819ac06bfc2209ead67a0376a3cf17ece767dcaf1ac1f1eeb732: Status 404 returned error can't find the container with id 238d7d25960f819ac06bfc2209ead67a0376a3cf17ece767dcaf1ac1f1eeb732 Jul 10 20:29:50.666539 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:50.666495 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b5fcf8fc5-cmdw6" event={"ID":"2a97bcd0-37da-4969-a350-9d65007e20e9","Type":"ContainerStarted","Data":"238d7d25960f819ac06bfc2209ead67a0376a3cf17ece767dcaf1ac1f1eeb732"} Jul 10 20:29:53.685622 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:53.685584 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b5fcf8fc5-cmdw6" event={"ID":"2a97bcd0-37da-4969-a350-9d65007e20e9","Type":"ContainerStarted","Data":"0c2593bba415f951ba355394f757f72dac68545dd213629c7878fe3d7e47e412"} Jul 10 20:29:53.702368 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:29:53.702309 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b5fcf8fc5-cmdw6" podStartSLOduration=1.79049726 podStartE2EDuration="4.702293012s" totalImagesPullingTime="2.911795752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:29:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:29:53.701189626 +0000 UTC m=+515.161394453" watchObservedRunningTime="2026-07-10 20:29:53.702293012 +0000 UTC m=+515.162497837" Jul 10 20:31:05.206913 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:05.206878 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp"] Jul 10 20:31:05.210381 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:05.210360 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" Jul 10 20:31:05.212840 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:05.212809 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 20:31:05.212974 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:05.212895 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 20:31:05.213971 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:05.213952 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nzk8q\"" Jul 10 20:31:05.219207 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:05.219181 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp"] Jul 10 20:31:05.344943 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:05.344903 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df564d34-8185-4241-b2ef-ecb915fa66ee-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp\" (UID: \"df564d34-8185-4241-b2ef-ecb915fa66ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" Jul 10 20:31:05.345118 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:05.344959 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z578\" (UniqueName: \"kubernetes.io/projected/df564d34-8185-4241-b2ef-ecb915fa66ee-kube-api-access-9z578\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp\" (UID: \"df564d34-8185-4241-b2ef-ecb915fa66ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" Jul 10 20:31:05.345118 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:05.345035 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df564d34-8185-4241-b2ef-ecb915fa66ee-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp\" (UID: \"df564d34-8185-4241-b2ef-ecb915fa66ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" Jul 10 20:31:05.445555 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:05.445509 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df564d34-8185-4241-b2ef-ecb915fa66ee-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp\" (UID: \"df564d34-8185-4241-b2ef-ecb915fa66ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" Jul 10 20:31:05.445722 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:05.445582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z578\" (UniqueName: \"kubernetes.io/projected/df564d34-8185-4241-b2ef-ecb915fa66ee-kube-api-access-9z578\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp\" (UID: \"df564d34-8185-4241-b2ef-ecb915fa66ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" Jul 10 20:31:05.445722 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:05.445603 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df564d34-8185-4241-b2ef-ecb915fa66ee-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp\" (UID: \"df564d34-8185-4241-b2ef-ecb915fa66ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" Jul 10 20:31:05.445938 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:05.445917 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df564d34-8185-4241-b2ef-ecb915fa66ee-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp\" (UID: \"df564d34-8185-4241-b2ef-ecb915fa66ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" Jul 10 20:31:05.445978 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:05.445950 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df564d34-8185-4241-b2ef-ecb915fa66ee-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp\" (UID: \"df564d34-8185-4241-b2ef-ecb915fa66ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" Jul 10 20:31:05.454427 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:05.454388 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z578\" (UniqueName: \"kubernetes.io/projected/df564d34-8185-4241-b2ef-ecb915fa66ee-kube-api-access-9z578\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp\" (UID: \"df564d34-8185-4241-b2ef-ecb915fa66ee\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" Jul 10 20:31:05.521245 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:05.521158 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" Jul 10 20:31:05.664625 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:05.664544 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp"] Jul 10 20:31:05.667142 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:31:05.667105 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf564d34_8185_4241_b2ef_ecb915fa66ee.slice/crio-90d72115abb1b8ae91565ddc263d874538e7602664d44ebc54598f264798ae01 WatchSource:0}: Error finding container 90d72115abb1b8ae91565ddc263d874538e7602664d44ebc54598f264798ae01: Status 404 returned error can't find the container with id 90d72115abb1b8ae91565ddc263d874538e7602664d44ebc54598f264798ae01 Jul 10 20:31:06.019176 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.019125 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv"] Jul 10 20:31:06.022732 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.022712 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" Jul 10 20:31:06.031429 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.031405 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv"] Jul 10 20:31:06.048807 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.048773 2580 generic.go:356] "Generic (PLEG): container finished" podID="df564d34-8185-4241-b2ef-ecb915fa66ee" containerID="e4a29f2d8229f7da04fdffd4fecf4d259af4d858cf5cd4c6afafe48300e825d7" exitCode=0 Jul 10 20:31:06.048970 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.048858 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" event={"ID":"df564d34-8185-4241-b2ef-ecb915fa66ee","Type":"ContainerDied","Data":"e4a29f2d8229f7da04fdffd4fecf4d259af4d858cf5cd4c6afafe48300e825d7"} Jul 10 20:31:06.048970 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.048909 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" event={"ID":"df564d34-8185-4241-b2ef-ecb915fa66ee","Type":"ContainerStarted","Data":"90d72115abb1b8ae91565ddc263d874538e7602664d44ebc54598f264798ae01"} Jul 10 20:31:06.152063 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.152022 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv\" (UID: \"d3864b89-dd3c-4de2-8128-7a2ebad60ccc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" Jul 10 20:31:06.152291 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.152083 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p9qk\" (UniqueName: \"kubernetes.io/projected/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-kube-api-access-7p9qk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv\" (UID: \"d3864b89-dd3c-4de2-8128-7a2ebad60ccc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" Jul 10 20:31:06.152291 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.152170 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv\" (UID: \"d3864b89-dd3c-4de2-8128-7a2ebad60ccc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" Jul 10 20:31:06.253373 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.253331 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p9qk\" (UniqueName: \"kubernetes.io/projected/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-kube-api-access-7p9qk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv\" (UID: \"d3864b89-dd3c-4de2-8128-7a2ebad60ccc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" Jul 10 20:31:06.253373 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.253380 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv\" (UID: \"d3864b89-dd3c-4de2-8128-7a2ebad60ccc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" Jul 10 20:31:06.253895 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.253476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv\" (UID: \"d3864b89-dd3c-4de2-8128-7a2ebad60ccc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" Jul 10 20:31:06.253895 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.253782 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv\" (UID: \"d3864b89-dd3c-4de2-8128-7a2ebad60ccc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" Jul 10 20:31:06.253895 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.253841 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv\" (UID: \"d3864b89-dd3c-4de2-8128-7a2ebad60ccc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" Jul 10 20:31:06.262695 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.262666 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p9qk\" (UniqueName: \"kubernetes.io/projected/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-kube-api-access-7p9qk\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv\" (UID: \"d3864b89-dd3c-4de2-8128-7a2ebad60ccc\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" Jul 10 20:31:06.333777 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.333689 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" Jul 10 20:31:06.467914 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.467887 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv"] Jul 10 20:31:06.470364 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:31:06.470331 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3864b89_dd3c_4de2_8128_7a2ebad60ccc.slice/crio-80c8170302ef68d9972b4090e345e33c0abe29e9907240bef7b9e0e7d7924c44 WatchSource:0}: Error finding container 80c8170302ef68d9972b4090e345e33c0abe29e9907240bef7b9e0e7d7924c44: Status 404 returned error can't find the container with id 80c8170302ef68d9972b4090e345e33c0abe29e9907240bef7b9e0e7d7924c44 Jul 10 20:31:06.808113 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.808079 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn"] Jul 10 20:31:06.812118 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.812093 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" Jul 10 20:31:06.820174 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.820144 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn"] Jul 10 20:31:06.958589 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.958492 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d2f098-e563-4227-bd4c-69216ae2ab0b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn\" (UID: \"86d2f098-e563-4227-bd4c-69216ae2ab0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" Jul 10 20:31:06.958589 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.958545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjxvk\" (UniqueName: \"kubernetes.io/projected/86d2f098-e563-4227-bd4c-69216ae2ab0b-kube-api-access-bjxvk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn\" (UID: \"86d2f098-e563-4227-bd4c-69216ae2ab0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" Jul 10 20:31:06.958767 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:06.958609 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d2f098-e563-4227-bd4c-69216ae2ab0b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn\" (UID: \"86d2f098-e563-4227-bd4c-69216ae2ab0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" Jul 10 20:31:07.055447 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.055415 2580 generic.go:356] "Generic (PLEG): container finished" podID="d3864b89-dd3c-4de2-8128-7a2ebad60ccc" containerID="7a06ce071e2d95842119d611a4f820a3c7771f422f098b6cc3114f9a055e6908" exitCode=0 Jul 10 20:31:07.055588 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.055477 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" event={"ID":"d3864b89-dd3c-4de2-8128-7a2ebad60ccc","Type":"ContainerDied","Data":"7a06ce071e2d95842119d611a4f820a3c7771f422f098b6cc3114f9a055e6908"} Jul 10 20:31:07.055588 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.055533 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" event={"ID":"d3864b89-dd3c-4de2-8128-7a2ebad60ccc","Type":"ContainerStarted","Data":"80c8170302ef68d9972b4090e345e33c0abe29e9907240bef7b9e0e7d7924c44"} Jul 10 20:31:07.057371 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.057347 2580 generic.go:356] "Generic (PLEG): container finished" podID="df564d34-8185-4241-b2ef-ecb915fa66ee" containerID="d8e39fa76bc224b476a5661e26e0be34417d289b0c94d08d8efdbeeeb7116a33" exitCode=0 Jul 10 20:31:07.057484 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.057461 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" event={"ID":"df564d34-8185-4241-b2ef-ecb915fa66ee","Type":"ContainerDied","Data":"d8e39fa76bc224b476a5661e26e0be34417d289b0c94d08d8efdbeeeb7116a33"} Jul 10 20:31:07.059236 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.059212 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d2f098-e563-4227-bd4c-69216ae2ab0b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn\" (UID: \"86d2f098-e563-4227-bd4c-69216ae2ab0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" Jul 10 20:31:07.059339 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.059261 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjxvk\" (UniqueName: \"kubernetes.io/projected/86d2f098-e563-4227-bd4c-69216ae2ab0b-kube-api-access-bjxvk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn\" (UID: \"86d2f098-e563-4227-bd4c-69216ae2ab0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" Jul 10 20:31:07.059339 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.059299 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d2f098-e563-4227-bd4c-69216ae2ab0b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn\" (UID: \"86d2f098-e563-4227-bd4c-69216ae2ab0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" Jul 10 20:31:07.059661 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.059642 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d2f098-e563-4227-bd4c-69216ae2ab0b-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn\" (UID: \"86d2f098-e563-4227-bd4c-69216ae2ab0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" Jul 10 20:31:07.059733 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.059674 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d2f098-e563-4227-bd4c-69216ae2ab0b-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn\" (UID: \"86d2f098-e563-4227-bd4c-69216ae2ab0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" Jul 10 20:31:07.066761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.066735 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjxvk\" (UniqueName: \"kubernetes.io/projected/86d2f098-e563-4227-bd4c-69216ae2ab0b-kube-api-access-bjxvk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn\" (UID: \"86d2f098-e563-4227-bd4c-69216ae2ab0b\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" Jul 10 20:31:07.137647 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.137621 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" Jul 10 20:31:07.275098 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.275068 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn"] Jul 10 20:31:07.278361 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:31:07.278336 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d2f098_e563_4227_bd4c_69216ae2ab0b.slice/crio-0b5b756ac0c46039fe4c556d314d34a10d9bba021a2d907cdf5e11a2875d21b4 WatchSource:0}: Error finding container 0b5b756ac0c46039fe4c556d314d34a10d9bba021a2d907cdf5e11a2875d21b4: Status 404 returned error can't find the container with id 0b5b756ac0c46039fe4c556d314d34a10d9bba021a2d907cdf5e11a2875d21b4 Jul 10 20:31:07.608423 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.608340 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m"] Jul 10 20:31:07.611914 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.611896 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" Jul 10 20:31:07.619700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.619677 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m"] Jul 10 20:31:07.665226 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.665188 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa8107cb-afc5-404b-9f6a-d9abcad758b9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m\" (UID: \"fa8107cb-afc5-404b-9f6a-d9abcad758b9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" Jul 10 20:31:07.665394 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.665302 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xshcz\" (UniqueName: \"kubernetes.io/projected/fa8107cb-afc5-404b-9f6a-d9abcad758b9-kube-api-access-xshcz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m\" (UID: \"fa8107cb-afc5-404b-9f6a-d9abcad758b9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" Jul 10 20:31:07.665394 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.665330 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa8107cb-afc5-404b-9f6a-d9abcad758b9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m\" (UID: \"fa8107cb-afc5-404b-9f6a-d9abcad758b9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" Jul 10 20:31:07.766035 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.765996 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xshcz\" (UniqueName: \"kubernetes.io/projected/fa8107cb-afc5-404b-9f6a-d9abcad758b9-kube-api-access-xshcz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m\" (UID: \"fa8107cb-afc5-404b-9f6a-d9abcad758b9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" Jul 10 20:31:07.766035 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.766037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa8107cb-afc5-404b-9f6a-d9abcad758b9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m\" (UID: \"fa8107cb-afc5-404b-9f6a-d9abcad758b9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" Jul 10 20:31:07.766325 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.766106 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa8107cb-afc5-404b-9f6a-d9abcad758b9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m\" (UID: \"fa8107cb-afc5-404b-9f6a-d9abcad758b9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" Jul 10 20:31:07.766551 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.766501 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa8107cb-afc5-404b-9f6a-d9abcad758b9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m\" (UID: \"fa8107cb-afc5-404b-9f6a-d9abcad758b9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" Jul 10 20:31:07.766624 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.766577 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa8107cb-afc5-404b-9f6a-d9abcad758b9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m\" (UID: \"fa8107cb-afc5-404b-9f6a-d9abcad758b9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" Jul 10 20:31:07.774956 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.774931 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xshcz\" (UniqueName: \"kubernetes.io/projected/fa8107cb-afc5-404b-9f6a-d9abcad758b9-kube-api-access-xshcz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m\" (UID: \"fa8107cb-afc5-404b-9f6a-d9abcad758b9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" Jul 10 20:31:07.921638 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:07.921597 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" Jul 10 20:31:08.066075 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.065979 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" event={"ID":"d3864b89-dd3c-4de2-8128-7a2ebad60ccc","Type":"ContainerStarted","Data":"54f50e92ba99be23d87ba3c1852ecc0b9c6cfd2d2ed198a1d17b03d0bb3208b1"} Jul 10 20:31:08.068774 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.068743 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m"] Jul 10 20:31:08.069691 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.069660 2580 generic.go:356] "Generic (PLEG): container finished" podID="df564d34-8185-4241-b2ef-ecb915fa66ee" containerID="ea5bc96b60357768bf0ccd005d354ada4730e8040321f6f3625562aaf818309b" exitCode=0 Jul 10 20:31:08.069809 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.069782 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" event={"ID":"df564d34-8185-4241-b2ef-ecb915fa66ee","Type":"ContainerDied","Data":"ea5bc96b60357768bf0ccd005d354ada4730e8040321f6f3625562aaf818309b"} Jul 10 20:31:08.071658 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.071629 2580 generic.go:356] "Generic (PLEG): container finished" podID="86d2f098-e563-4227-bd4c-69216ae2ab0b" containerID="0be2c732d24f4fe834307739e0a6ded6c6679a418a350b5c6499513b43e1eda0" exitCode=0 Jul 10 20:31:08.071817 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.071748 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" event={"ID":"86d2f098-e563-4227-bd4c-69216ae2ab0b","Type":"ContainerDied","Data":"0be2c732d24f4fe834307739e0a6ded6c6679a418a350b5c6499513b43e1eda0"} Jul 10 20:31:08.072355 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.072333 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" event={"ID":"86d2f098-e563-4227-bd4c-69216ae2ab0b","Type":"ContainerStarted","Data":"0b5b756ac0c46039fe4c556d314d34a10d9bba021a2d907cdf5e11a2875d21b4"} Jul 10 20:31:08.072355 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:31:08.072206 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8107cb_afc5_404b_9f6a_d9abcad758b9.slice/crio-daef87f041d5bd6a5ae8f6d6d8f11ad4ce8e7c36ae66428e8dc48e9f05996314 WatchSource:0}: Error finding container daef87f041d5bd6a5ae8f6d6d8f11ad4ce8e7c36ae66428e8dc48e9f05996314: Status 404 returned error can't find the container with id daef87f041d5bd6a5ae8f6d6d8f11ad4ce8e7c36ae66428e8dc48e9f05996314 Jul 10 20:31:08.637720 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.637690 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7796ddb6f5-5zwxf"] Jul 10 20:31:08.641034 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.641008 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.652410 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.652383 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7796ddb6f5-5zwxf"] Jul 10 20:31:08.775119 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.775041 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ks6w\" (UniqueName: \"kubernetes.io/projected/bb848394-db03-494f-b800-2465bb43927f-kube-api-access-8ks6w\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.775119 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.775083 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb848394-db03-494f-b800-2465bb43927f-console-serving-cert\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.775356 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.775254 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb848394-db03-494f-b800-2465bb43927f-console-config\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.775356 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.775288 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb848394-db03-494f-b800-2465bb43927f-service-ca\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.775356 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.775321 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb848394-db03-494f-b800-2465bb43927f-console-oauth-config\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.775356 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.775345 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb848394-db03-494f-b800-2465bb43927f-trusted-ca-bundle\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.775520 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.775374 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb848394-db03-494f-b800-2465bb43927f-oauth-serving-cert\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.876253 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.876219 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb848394-db03-494f-b800-2465bb43927f-console-config\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.876253 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.876259 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb848394-db03-494f-b800-2465bb43927f-service-ca\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.876482 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.876288 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb848394-db03-494f-b800-2465bb43927f-console-oauth-config\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.876482 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.876311 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb848394-db03-494f-b800-2465bb43927f-trusted-ca-bundle\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.876482 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.876337 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb848394-db03-494f-b800-2465bb43927f-oauth-serving-cert\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.876482 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.876416 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ks6w\" (UniqueName: \"kubernetes.io/projected/bb848394-db03-494f-b800-2465bb43927f-kube-api-access-8ks6w\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.876482 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.876446 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb848394-db03-494f-b800-2465bb43927f-console-serving-cert\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.877100 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.877075 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb848394-db03-494f-b800-2465bb43927f-console-config\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.877474 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.877187 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb848394-db03-494f-b800-2465bb43927f-service-ca\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.877474 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.877192 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb848394-db03-494f-b800-2465bb43927f-oauth-serving-cert\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.877474 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.877193 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb848394-db03-494f-b800-2465bb43927f-trusted-ca-bundle\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.878731 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.878703 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb848394-db03-494f-b800-2465bb43927f-console-oauth-config\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.878881 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.878862 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb848394-db03-494f-b800-2465bb43927f-console-serving-cert\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.889395 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.889368 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ks6w\" (UniqueName: \"kubernetes.io/projected/bb848394-db03-494f-b800-2465bb43927f-kube-api-access-8ks6w\") pod \"console-7796ddb6f5-5zwxf\" (UID: \"bb848394-db03-494f-b800-2465bb43927f\") " pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:08.949801 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:08.949775 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:09.082224 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.082123 2580 generic.go:356] "Generic (PLEG): container finished" podID="d3864b89-dd3c-4de2-8128-7a2ebad60ccc" containerID="54f50e92ba99be23d87ba3c1852ecc0b9c6cfd2d2ed198a1d17b03d0bb3208b1" exitCode=0 Jul 10 20:31:09.082388 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.082189 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" event={"ID":"d3864b89-dd3c-4de2-8128-7a2ebad60ccc","Type":"ContainerDied","Data":"54f50e92ba99be23d87ba3c1852ecc0b9c6cfd2d2ed198a1d17b03d0bb3208b1"} Jul 10 20:31:09.083904 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.083883 2580 generic.go:356] "Generic (PLEG): container finished" podID="fa8107cb-afc5-404b-9f6a-d9abcad758b9" containerID="7ebf6c683fea63a278ee3e46c8d7c9fca09abe93a230e8be5f94846adbccebd5" exitCode=0 Jul 10 20:31:09.083999 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.083911 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" event={"ID":"fa8107cb-afc5-404b-9f6a-d9abcad758b9","Type":"ContainerDied","Data":"7ebf6c683fea63a278ee3e46c8d7c9fca09abe93a230e8be5f94846adbccebd5"} Jul 10 20:31:09.083999 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.083956 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" event={"ID":"fa8107cb-afc5-404b-9f6a-d9abcad758b9","Type":"ContainerStarted","Data":"daef87f041d5bd6a5ae8f6d6d8f11ad4ce8e7c36ae66428e8dc48e9f05996314"} Jul 10 20:31:09.085860 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.085836 2580 generic.go:356] "Generic (PLEG): container finished" podID="86d2f098-e563-4227-bd4c-69216ae2ab0b" containerID="48e89b2f4a4fcb0d0cc7dc078f6c9548f399ea50cb6bffebdb3e81f0fbbc190e" exitCode=0 Jul 10 20:31:09.085955 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.085899 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" event={"ID":"86d2f098-e563-4227-bd4c-69216ae2ab0b","Type":"ContainerDied","Data":"48e89b2f4a4fcb0d0cc7dc078f6c9548f399ea50cb6bffebdb3e81f0fbbc190e"} Jul 10 20:31:09.098004 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.097975 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7796ddb6f5-5zwxf"] Jul 10 20:31:09.101637 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:31:09.101594 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb848394_db03_494f_b800_2465bb43927f.slice/crio-7286c12b2e9e746e1a71d1a1a0ddd8d2dc51b338cbf44f4be629e5c5f90bb629 WatchSource:0}: Error finding container 7286c12b2e9e746e1a71d1a1a0ddd8d2dc51b338cbf44f4be629e5c5f90bb629: Status 404 returned error can't find the container with id 7286c12b2e9e746e1a71d1a1a0ddd8d2dc51b338cbf44f4be629e5c5f90bb629 Jul 10 20:31:09.224328 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.224265 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" Jul 10 20:31:09.279437 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.279341 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z578\" (UniqueName: \"kubernetes.io/projected/df564d34-8185-4241-b2ef-ecb915fa66ee-kube-api-access-9z578\") pod \"df564d34-8185-4241-b2ef-ecb915fa66ee\" (UID: \"df564d34-8185-4241-b2ef-ecb915fa66ee\") " Jul 10 20:31:09.279592 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.279452 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df564d34-8185-4241-b2ef-ecb915fa66ee-util\") pod \"df564d34-8185-4241-b2ef-ecb915fa66ee\" (UID: \"df564d34-8185-4241-b2ef-ecb915fa66ee\") " Jul 10 20:31:09.279592 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.279473 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df564d34-8185-4241-b2ef-ecb915fa66ee-bundle\") pod \"df564d34-8185-4241-b2ef-ecb915fa66ee\" (UID: \"df564d34-8185-4241-b2ef-ecb915fa66ee\") " Jul 10 20:31:09.280083 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.280056 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df564d34-8185-4241-b2ef-ecb915fa66ee-bundle" (OuterVolumeSpecName: "bundle") pod "df564d34-8185-4241-b2ef-ecb915fa66ee" (UID: "df564d34-8185-4241-b2ef-ecb915fa66ee"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:31:09.281596 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.281572 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df564d34-8185-4241-b2ef-ecb915fa66ee-kube-api-access-9z578" (OuterVolumeSpecName: "kube-api-access-9z578") pod "df564d34-8185-4241-b2ef-ecb915fa66ee" (UID: "df564d34-8185-4241-b2ef-ecb915fa66ee"). InnerVolumeSpecName "kube-api-access-9z578". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:31:09.286184 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.286155 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df564d34-8185-4241-b2ef-ecb915fa66ee-util" (OuterVolumeSpecName: "util") pod "df564d34-8185-4241-b2ef-ecb915fa66ee" (UID: "df564d34-8185-4241-b2ef-ecb915fa66ee"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:31:09.380575 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.380544 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z578\" (UniqueName: \"kubernetes.io/projected/df564d34-8185-4241-b2ef-ecb915fa66ee-kube-api-access-9z578\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:09.380575 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.380573 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df564d34-8185-4241-b2ef-ecb915fa66ee-util\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:09.380575 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:09.380585 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df564d34-8185-4241-b2ef-ecb915fa66ee-bundle\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:10.093556 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:10.093521 2580 generic.go:356] "Generic (PLEG): container finished" podID="d3864b89-dd3c-4de2-8128-7a2ebad60ccc" containerID="a4447b68713ed7d54182bfb2c46be9a624ff35b7f60de56553a822a29abda115" exitCode=0 Jul 10 20:31:10.094024 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:10.093610 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" event={"ID":"d3864b89-dd3c-4de2-8128-7a2ebad60ccc","Type":"ContainerDied","Data":"a4447b68713ed7d54182bfb2c46be9a624ff35b7f60de56553a822a29abda115"} Jul 10 20:31:10.095241 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:10.095214 2580 generic.go:356] "Generic (PLEG): container finished" podID="fa8107cb-afc5-404b-9f6a-d9abcad758b9" containerID="d987270ffcac49cb2ce50479c80435c2f048a5f89ab42ceef857f297c4331f8e" exitCode=0 Jul 10 20:31:10.095352 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:10.095292 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" event={"ID":"fa8107cb-afc5-404b-9f6a-d9abcad758b9","Type":"ContainerDied","Data":"d987270ffcac49cb2ce50479c80435c2f048a5f89ab42ceef857f297c4331f8e"} Jul 10 20:31:10.097237 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:10.097174 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" event={"ID":"df564d34-8185-4241-b2ef-ecb915fa66ee","Type":"ContainerDied","Data":"90d72115abb1b8ae91565ddc263d874538e7602664d44ebc54598f264798ae01"} Jul 10 20:31:10.097341 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:10.097262 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="90d72115abb1b8ae91565ddc263d874538e7602664d44ebc54598f264798ae01" Jul 10 20:31:10.097341 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:10.097214 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp" Jul 10 20:31:10.099601 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:10.099567 2580 generic.go:356] "Generic (PLEG): container finished" podID="86d2f098-e563-4227-bd4c-69216ae2ab0b" containerID="daf6c932f289f4c0351b2ce90e261dae311d29c7b3d61e8a8b90cfc710d2da11" exitCode=0 Jul 10 20:31:10.099700 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:10.099591 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" event={"ID":"86d2f098-e563-4227-bd4c-69216ae2ab0b","Type":"ContainerDied","Data":"daf6c932f289f4c0351b2ce90e261dae311d29c7b3d61e8a8b90cfc710d2da11"} Jul 10 20:31:10.101250 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:10.101231 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7796ddb6f5-5zwxf" event={"ID":"bb848394-db03-494f-b800-2465bb43927f","Type":"ContainerStarted","Data":"ac43fec8d675cf28610a09348b8450c2e882dc5abf11365f51dec25ec724f60a"} Jul 10 20:31:10.101316 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:10.101265 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7796ddb6f5-5zwxf" event={"ID":"bb848394-db03-494f-b800-2465bb43927f","Type":"ContainerStarted","Data":"7286c12b2e9e746e1a71d1a1a0ddd8d2dc51b338cbf44f4be629e5c5f90bb629"} Jul 10 20:31:10.132076 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:10.132020 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7796ddb6f5-5zwxf" podStartSLOduration=2.132003465 podStartE2EDuration="2.132003465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:31:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:31:10.131453874 +0000 UTC m=+591.591658703" watchObservedRunningTime="2026-07-10 20:31:10.132003465 +0000 UTC m=+591.592208290" Jul 10 20:31:11.108193 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.108161 2580 generic.go:356] "Generic (PLEG): container finished" podID="fa8107cb-afc5-404b-9f6a-d9abcad758b9" containerID="3430fabede6f166cd658a54d217127d9b5f16c1a9c1db0a3c92e6841117e6771" exitCode=0 Jul 10 20:31:11.108669 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.108249 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" event={"ID":"fa8107cb-afc5-404b-9f6a-d9abcad758b9","Type":"ContainerDied","Data":"3430fabede6f166cd658a54d217127d9b5f16c1a9c1db0a3c92e6841117e6771"} Jul 10 20:31:11.258222 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.258195 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" Jul 10 20:31:11.274811 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.274787 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" Jul 10 20:31:11.397347 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.397315 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d2f098-e563-4227-bd4c-69216ae2ab0b-util\") pod \"86d2f098-e563-4227-bd4c-69216ae2ab0b\" (UID: \"86d2f098-e563-4227-bd4c-69216ae2ab0b\") " Jul 10 20:31:11.397514 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.397367 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d2f098-e563-4227-bd4c-69216ae2ab0b-bundle\") pod \"86d2f098-e563-4227-bd4c-69216ae2ab0b\" (UID: \"86d2f098-e563-4227-bd4c-69216ae2ab0b\") " Jul 10 20:31:11.397514 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.397395 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-util\") pod \"d3864b89-dd3c-4de2-8128-7a2ebad60ccc\" (UID: \"d3864b89-dd3c-4de2-8128-7a2ebad60ccc\") " Jul 10 20:31:11.397514 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.397425 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7p9qk\" (UniqueName: \"kubernetes.io/projected/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-kube-api-access-7p9qk\") pod \"d3864b89-dd3c-4de2-8128-7a2ebad60ccc\" (UID: \"d3864b89-dd3c-4de2-8128-7a2ebad60ccc\") " Jul 10 20:31:11.397514 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.397440 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjxvk\" (UniqueName: \"kubernetes.io/projected/86d2f098-e563-4227-bd4c-69216ae2ab0b-kube-api-access-bjxvk\") pod \"86d2f098-e563-4227-bd4c-69216ae2ab0b\" (UID: \"86d2f098-e563-4227-bd4c-69216ae2ab0b\") " Jul 10 20:31:11.397514 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.397483 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-bundle\") pod \"d3864b89-dd3c-4de2-8128-7a2ebad60ccc\" (UID: \"d3864b89-dd3c-4de2-8128-7a2ebad60ccc\") " Jul 10 20:31:11.398001 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.397969 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-bundle" (OuterVolumeSpecName: "bundle") pod "d3864b89-dd3c-4de2-8128-7a2ebad60ccc" (UID: "d3864b89-dd3c-4de2-8128-7a2ebad60ccc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:31:11.398118 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.398012 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86d2f098-e563-4227-bd4c-69216ae2ab0b-bundle" (OuterVolumeSpecName: "bundle") pod "86d2f098-e563-4227-bd4c-69216ae2ab0b" (UID: "86d2f098-e563-4227-bd4c-69216ae2ab0b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:31:11.399558 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.399535 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-kube-api-access-7p9qk" (OuterVolumeSpecName: "kube-api-access-7p9qk") pod "d3864b89-dd3c-4de2-8128-7a2ebad60ccc" (UID: "d3864b89-dd3c-4de2-8128-7a2ebad60ccc"). InnerVolumeSpecName "kube-api-access-7p9qk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:31:11.399856 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.399833 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86d2f098-e563-4227-bd4c-69216ae2ab0b-kube-api-access-bjxvk" (OuterVolumeSpecName: "kube-api-access-bjxvk") pod "86d2f098-e563-4227-bd4c-69216ae2ab0b" (UID: "86d2f098-e563-4227-bd4c-69216ae2ab0b"). InnerVolumeSpecName "kube-api-access-bjxvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:31:11.403655 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.403633 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86d2f098-e563-4227-bd4c-69216ae2ab0b-util" (OuterVolumeSpecName: "util") pod "86d2f098-e563-4227-bd4c-69216ae2ab0b" (UID: "86d2f098-e563-4227-bd4c-69216ae2ab0b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:31:11.404761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.404732 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-util" (OuterVolumeSpecName: "util") pod "d3864b89-dd3c-4de2-8128-7a2ebad60ccc" (UID: "d3864b89-dd3c-4de2-8128-7a2ebad60ccc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:31:11.498418 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.498387 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86d2f098-e563-4227-bd4c-69216ae2ab0b-util\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:11.498418 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.498414 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86d2f098-e563-4227-bd4c-69216ae2ab0b-bundle\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:11.498418 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.498423 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-util\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:11.498635 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.498432 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7p9qk\" (UniqueName: \"kubernetes.io/projected/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-kube-api-access-7p9qk\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:11.498635 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.498443 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjxvk\" (UniqueName: \"kubernetes.io/projected/86d2f098-e563-4227-bd4c-69216ae2ab0b-kube-api-access-bjxvk\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:11.498635 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:11.498453 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3864b89-dd3c-4de2-8128-7a2ebad60ccc-bundle\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:12.115601 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:12.115522 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" Jul 10 20:31:12.115601 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:12.115558 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn" event={"ID":"86d2f098-e563-4227-bd4c-69216ae2ab0b","Type":"ContainerDied","Data":"0b5b756ac0c46039fe4c556d314d34a10d9bba021a2d907cdf5e11a2875d21b4"} Jul 10 20:31:12.116018 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:12.115610 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b5b756ac0c46039fe4c556d314d34a10d9bba021a2d907cdf5e11a2875d21b4" Jul 10 20:31:12.117451 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:12.117411 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" event={"ID":"d3864b89-dd3c-4de2-8128-7a2ebad60ccc","Type":"ContainerDied","Data":"80c8170302ef68d9972b4090e345e33c0abe29e9907240bef7b9e0e7d7924c44"} Jul 10 20:31:12.117583 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:12.117475 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80c8170302ef68d9972b4090e345e33c0abe29e9907240bef7b9e0e7d7924c44" Jul 10 20:31:12.117583 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:12.117428 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv" Jul 10 20:31:12.235023 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:12.234998 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" Jul 10 20:31:12.305690 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:12.305653 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa8107cb-afc5-404b-9f6a-d9abcad758b9-util\") pod \"fa8107cb-afc5-404b-9f6a-d9abcad758b9\" (UID: \"fa8107cb-afc5-404b-9f6a-d9abcad758b9\") " Jul 10 20:31:12.305690 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:12.305703 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xshcz\" (UniqueName: \"kubernetes.io/projected/fa8107cb-afc5-404b-9f6a-d9abcad758b9-kube-api-access-xshcz\") pod \"fa8107cb-afc5-404b-9f6a-d9abcad758b9\" (UID: \"fa8107cb-afc5-404b-9f6a-d9abcad758b9\") " Jul 10 20:31:12.305942 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:12.305771 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa8107cb-afc5-404b-9f6a-d9abcad758b9-bundle\") pod \"fa8107cb-afc5-404b-9f6a-d9abcad758b9\" (UID: \"fa8107cb-afc5-404b-9f6a-d9abcad758b9\") " Jul 10 20:31:12.306536 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:12.306506 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa8107cb-afc5-404b-9f6a-d9abcad758b9-bundle" (OuterVolumeSpecName: "bundle") pod "fa8107cb-afc5-404b-9f6a-d9abcad758b9" (UID: "fa8107cb-afc5-404b-9f6a-d9abcad758b9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:31:12.308101 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:12.308074 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8107cb-afc5-404b-9f6a-d9abcad758b9-kube-api-access-xshcz" (OuterVolumeSpecName: "kube-api-access-xshcz") pod "fa8107cb-afc5-404b-9f6a-d9abcad758b9" (UID: "fa8107cb-afc5-404b-9f6a-d9abcad758b9"). InnerVolumeSpecName "kube-api-access-xshcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:31:12.310718 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:12.310679 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa8107cb-afc5-404b-9f6a-d9abcad758b9-util" (OuterVolumeSpecName: "util") pod "fa8107cb-afc5-404b-9f6a-d9abcad758b9" (UID: "fa8107cb-afc5-404b-9f6a-d9abcad758b9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:31:12.406651 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:12.406617 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa8107cb-afc5-404b-9f6a-d9abcad758b9-bundle\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:12.406651 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:12.406650 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa8107cb-afc5-404b-9f6a-d9abcad758b9-util\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:12.406858 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:12.406662 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xshcz\" (UniqueName: \"kubernetes.io/projected/fa8107cb-afc5-404b-9f6a-d9abcad758b9-kube-api-access-xshcz\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:13.124573 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:13.124536 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" event={"ID":"fa8107cb-afc5-404b-9f6a-d9abcad758b9","Type":"ContainerDied","Data":"daef87f041d5bd6a5ae8f6d6d8f11ad4ce8e7c36ae66428e8dc48e9f05996314"} Jul 10 20:31:13.124573 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:13.124557 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m" Jul 10 20:31:13.125113 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:13.124614 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="daef87f041d5bd6a5ae8f6d6d8f11ad4ce8e7c36ae66428e8dc48e9f05996314" Jul 10 20:31:18.949979 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:18.949949 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:18.950397 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:18.950007 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:18.954730 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:18.954706 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:19.161448 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:19.161417 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7796ddb6f5-5zwxf" Jul 10 20:31:19.250907 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:19.250823 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55ccb47ccd-9gxcz"] Jul 10 20:31:19.549611 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:19.549532 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:31:19.549942 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:19.549747 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:31:44.272978 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.272897 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55ccb47ccd-9gxcz" podUID="1f45e97c-c7ca-49da-9e9c-07d4a0887bb6" containerName="console" containerID="cri-o://2ce9b96bb43244cf8b5fb487f3d43f3154e72247b96ed7683bf7bf7bbec64006" gracePeriod=15 Jul 10 20:31:44.521549 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.521523 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:31:44.577913 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.577832 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-oauth-config\") pod \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " Jul 10 20:31:44.577913 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.577865 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-serving-cert\") pod \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " Jul 10 20:31:44.577913 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.577898 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-oauth-serving-cert\") pod \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " Jul 10 20:31:44.578187 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.578034 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p42lr\" (UniqueName: \"kubernetes.io/projected/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-kube-api-access-p42lr\") pod \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " Jul 10 20:31:44.578187 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.578079 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-trusted-ca-bundle\") pod \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " Jul 10 20:31:44.578187 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.578112 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-config\") pod \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " Jul 10 20:31:44.578365 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.578208 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-service-ca\") pod \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\" (UID: \"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6\") " Jul 10 20:31:44.578452 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.578418 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f45e97c-c7ca-49da-9e9c-07d4a0887bb6" (UID: "1f45e97c-c7ca-49da-9e9c-07d4a0887bb6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:31:44.578550 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.578517 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1f45e97c-c7ca-49da-9e9c-07d4a0887bb6" (UID: "1f45e97c-c7ca-49da-9e9c-07d4a0887bb6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:31:44.578550 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.578520 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-config" (OuterVolumeSpecName: "console-config") pod "1f45e97c-c7ca-49da-9e9c-07d4a0887bb6" (UID: "1f45e97c-c7ca-49da-9e9c-07d4a0887bb6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:31:44.578787 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.578763 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f45e97c-c7ca-49da-9e9c-07d4a0887bb6" (UID: "1f45e97c-c7ca-49da-9e9c-07d4a0887bb6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 20:31:44.580154 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.580116 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f45e97c-c7ca-49da-9e9c-07d4a0887bb6" (UID: "1f45e97c-c7ca-49da-9e9c-07d4a0887bb6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:31:44.580253 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.580151 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-kube-api-access-p42lr" (OuterVolumeSpecName: "kube-api-access-p42lr") pod "1f45e97c-c7ca-49da-9e9c-07d4a0887bb6" (UID: "1f45e97c-c7ca-49da-9e9c-07d4a0887bb6"). InnerVolumeSpecName "kube-api-access-p42lr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:31:44.580253 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.580216 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f45e97c-c7ca-49da-9e9c-07d4a0887bb6" (UID: "1f45e97c-c7ca-49da-9e9c-07d4a0887bb6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:31:44.679381 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.679346 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p42lr\" (UniqueName: \"kubernetes.io/projected/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-kube-api-access-p42lr\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:44.679381 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.679388 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-trusted-ca-bundle\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:44.679580 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.679398 2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-config\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:44.679580 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.679407 2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-service-ca\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:44.679580 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.679415 2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-oauth-config\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:44.679580 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.679423 2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-console-serving-cert\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:44.679580 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:44.679432 2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6-oauth-serving-cert\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:31:45.297311 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.297274 2580 generic.go:356] "Generic (PLEG): container finished" podID="1f45e97c-c7ca-49da-9e9c-07d4a0887bb6" containerID="2ce9b96bb43244cf8b5fb487f3d43f3154e72247b96ed7683bf7bf7bbec64006" exitCode=0 Jul 10 20:31:45.297787 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.297327 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55ccb47ccd-9gxcz" event={"ID":"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6","Type":"ContainerDied","Data":"2ce9b96bb43244cf8b5fb487f3d43f3154e72247b96ed7683bf7bf7bbec64006"} Jul 10 20:31:45.297787 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.297372 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55ccb47ccd-9gxcz" Jul 10 20:31:45.297787 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.297398 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55ccb47ccd-9gxcz" event={"ID":"1f45e97c-c7ca-49da-9e9c-07d4a0887bb6","Type":"ContainerDied","Data":"e0ea06d1d404f0a5d1f5620311eeb164adc85f3130c0f296452baa4918cbf7a3"} Jul 10 20:31:45.297787 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.297425 2580 scope.go:117] "RemoveContainer" containerID="2ce9b96bb43244cf8b5fb487f3d43f3154e72247b96ed7683bf7bf7bbec64006" Jul 10 20:31:45.308646 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.308622 2580 scope.go:117] "RemoveContainer" containerID="2ce9b96bb43244cf8b5fb487f3d43f3154e72247b96ed7683bf7bf7bbec64006" Jul 10 20:31:45.308896 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:31:45.308879 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ce9b96bb43244cf8b5fb487f3d43f3154e72247b96ed7683bf7bf7bbec64006\": container with ID starting with 2ce9b96bb43244cf8b5fb487f3d43f3154e72247b96ed7683bf7bf7bbec64006 not found: ID does not exist" containerID="2ce9b96bb43244cf8b5fb487f3d43f3154e72247b96ed7683bf7bf7bbec64006" Jul 10 20:31:45.308987 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.308904 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ce9b96bb43244cf8b5fb487f3d43f3154e72247b96ed7683bf7bf7bbec64006"} err="failed to get container status \"2ce9b96bb43244cf8b5fb487f3d43f3154e72247b96ed7683bf7bf7bbec64006\": rpc error: code = NotFound desc = could not find container \"2ce9b96bb43244cf8b5fb487f3d43f3154e72247b96ed7683bf7bf7bbec64006\": container with ID starting with 2ce9b96bb43244cf8b5fb487f3d43f3154e72247b96ed7683bf7bf7bbec64006 not found: ID does not exist" Jul 10 20:31:45.322455 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.322431 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55ccb47ccd-9gxcz"] Jul 10 20:31:45.328261 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.328233 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55ccb47ccd-9gxcz"] Jul 10 20:31:45.661143 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.661093 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f45e97c-c7ca-49da-9e9c-07d4a0887bb6" path="/var/lib/kubelet/pods/1f45e97c-c7ca-49da-9e9c-07d4a0887bb6/volumes" Jul 10 20:31:45.839042 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839005 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8"] Jul 10 20:31:45.839365 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839352 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8107cb-afc5-404b-9f6a-d9abcad758b9" containerName="extract" Jul 10 20:31:45.839434 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839366 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8107cb-afc5-404b-9f6a-d9abcad758b9" containerName="extract" Jul 10 20:31:45.839434 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839377 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df564d34-8185-4241-b2ef-ecb915fa66ee" containerName="pull" Jul 10 20:31:45.839434 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839383 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="df564d34-8185-4241-b2ef-ecb915fa66ee" containerName="pull" Jul 10 20:31:45.839434 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839392 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d2f098-e563-4227-bd4c-69216ae2ab0b" containerName="util" Jul 10 20:31:45.839434 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839397 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d2f098-e563-4227-bd4c-69216ae2ab0b" containerName="util" Jul 10 20:31:45.839434 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839405 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df564d34-8185-4241-b2ef-ecb915fa66ee" containerName="util" Jul 10 20:31:45.839434 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839410 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="df564d34-8185-4241-b2ef-ecb915fa66ee" containerName="util" Jul 10 20:31:45.839434 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839416 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d2f098-e563-4227-bd4c-69216ae2ab0b" containerName="pull" Jul 10 20:31:45.839434 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839421 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d2f098-e563-4227-bd4c-69216ae2ab0b" containerName="pull" Jul 10 20:31:45.839434 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839427 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3864b89-dd3c-4de2-8128-7a2ebad60ccc" containerName="util" Jul 10 20:31:45.839434 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839432 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3864b89-dd3c-4de2-8128-7a2ebad60ccc" containerName="util" Jul 10 20:31:45.839434 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839437 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3864b89-dd3c-4de2-8128-7a2ebad60ccc" containerName="pull" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839442 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3864b89-dd3c-4de2-8128-7a2ebad60ccc" containerName="pull" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839448 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d2f098-e563-4227-bd4c-69216ae2ab0b" containerName="extract" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839453 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d2f098-e563-4227-bd4c-69216ae2ab0b" containerName="extract" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839469 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f45e97c-c7ca-49da-9e9c-07d4a0887bb6" containerName="console" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839474 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f45e97c-c7ca-49da-9e9c-07d4a0887bb6" containerName="console" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839480 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8107cb-afc5-404b-9f6a-d9abcad758b9" containerName="util" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839485 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8107cb-afc5-404b-9f6a-d9abcad758b9" containerName="util" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839490 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3864b89-dd3c-4de2-8128-7a2ebad60ccc" containerName="extract" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839495 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3864b89-dd3c-4de2-8128-7a2ebad60ccc" containerName="extract" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839501 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8107cb-afc5-404b-9f6a-d9abcad758b9" containerName="pull" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839505 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8107cb-afc5-404b-9f6a-d9abcad758b9" containerName="pull" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839512 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df564d34-8185-4241-b2ef-ecb915fa66ee" containerName="extract" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839518 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="df564d34-8185-4241-b2ef-ecb915fa66ee" containerName="extract" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839569 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa8107cb-afc5-404b-9f6a-d9abcad758b9" containerName="extract" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839579 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="df564d34-8185-4241-b2ef-ecb915fa66ee" containerName="extract" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839586 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="86d2f098-e563-4227-bd4c-69216ae2ab0b" containerName="extract" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839592 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3864b89-dd3c-4de2-8128-7a2ebad60ccc" containerName="extract" Jul 10 20:31:45.839789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.839599 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f45e97c-c7ca-49da-9e9c-07d4a0887bb6" containerName="console" Jul 10 20:31:45.843833 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.843817 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" Jul 10 20:31:45.846292 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.846267 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 20:31:45.846292 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.846283 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gbr7t\"" Jul 10 20:31:45.846460 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.846267 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 20:31:45.861003 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.860976 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8"] Jul 10 20:31:45.889714 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.889680 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg5hl\" (UniqueName: \"kubernetes.io/projected/427c1053-165f-4315-972d-de8c5276dd1c-kube-api-access-fg5hl\") pod \"kuadrant-operator-controller-manager-86878c769f-v9rm8\" (UID: \"427c1053-165f-4315-972d-de8c5276dd1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" Jul 10 20:31:45.889889 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.889730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/427c1053-165f-4315-972d-de8c5276dd1c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v9rm8\" (UID: \"427c1053-165f-4315-972d-de8c5276dd1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" Jul 10 20:31:45.991089 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.991001 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/427c1053-165f-4315-972d-de8c5276dd1c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v9rm8\" (UID: \"427c1053-165f-4315-972d-de8c5276dd1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" Jul 10 20:31:45.991250 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.991087 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg5hl\" (UniqueName: \"kubernetes.io/projected/427c1053-165f-4315-972d-de8c5276dd1c-kube-api-access-fg5hl\") pod \"kuadrant-operator-controller-manager-86878c769f-v9rm8\" (UID: \"427c1053-165f-4315-972d-de8c5276dd1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" Jul 10 20:31:45.991408 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:45.991387 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/427c1053-165f-4315-972d-de8c5276dd1c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v9rm8\" (UID: \"427c1053-165f-4315-972d-de8c5276dd1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" Jul 10 20:31:46.000499 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:46.000478 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg5hl\" (UniqueName: \"kubernetes.io/projected/427c1053-165f-4315-972d-de8c5276dd1c-kube-api-access-fg5hl\") pod \"kuadrant-operator-controller-manager-86878c769f-v9rm8\" (UID: \"427c1053-165f-4315-972d-de8c5276dd1c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" Jul 10 20:31:46.153997 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:46.153963 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" Jul 10 20:31:46.290664 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:46.290580 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8"] Jul 10 20:31:46.293945 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:31:46.293918 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod427c1053_165f_4315_972d_de8c5276dd1c.slice/crio-b388b17c35ef01caaf1f43d161d7adf9821ec6d191c989b0297f6db8add628e5 WatchSource:0}: Error finding container b388b17c35ef01caaf1f43d161d7adf9821ec6d191c989b0297f6db8add628e5: Status 404 returned error can't find the container with id b388b17c35ef01caaf1f43d161d7adf9821ec6d191c989b0297f6db8add628e5 Jul 10 20:31:46.306282 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:46.306252 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" event={"ID":"427c1053-165f-4315-972d-de8c5276dd1c","Type":"ContainerStarted","Data":"b388b17c35ef01caaf1f43d161d7adf9821ec6d191c989b0297f6db8add628e5"} Jul 10 20:31:52.342640 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:52.342592 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" event={"ID":"427c1053-165f-4315-972d-de8c5276dd1c","Type":"ContainerStarted","Data":"4fa5a00e7c8ea8e504f8a242b99a0ee057f34a1e5b672d86e4ca75cf37f63918"} Jul 10 20:31:52.343037 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:52.342661 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" Jul 10 20:31:52.363863 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:31:52.363796 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" podStartSLOduration=1.8052989419999999 podStartE2EDuration="7.363778418s" totalImagesPullingTime="5.558479476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:31:52.362443274 +0000 UTC m=+633.822648100" watchObservedRunningTime="2026-07-10 20:31:52.363778418 +0000 UTC m=+633.823983247" Jul 10 20:32:03.350377 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:03.350344 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" Jul 10 20:32:19.548678 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:19.548643 2580 scope.go:117] "RemoveContainer" containerID="98e41ee1a51993ae99edcc41aad0bde09392f6ecf4fb6775edba0685fd0682c1" Jul 10 20:32:22.623959 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:22.623905 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-59598"] Jul 10 20:32:22.631176 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:22.631153 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-59598" Jul 10 20:32:22.633708 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:22.633679 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lsvv7\"" Jul 10 20:32:22.635363 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:22.635341 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-59598"] Jul 10 20:32:22.803279 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:22.803242 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-dpxds"] Jul 10 20:32:22.806905 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:22.806879 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dpxds" Jul 10 20:32:22.812711 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:22.812688 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dpxds"] Jul 10 20:32:22.823659 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:22.823625 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrnck\" (UniqueName: \"kubernetes.io/projected/a5c6f427-5082-4281-bda2-092299ecf3ae-kube-api-access-qrnck\") pod \"authorino-58cd955675-59598\" (UID: \"a5c6f427-5082-4281-bda2-092299ecf3ae\") " pod="kuadrant-system/authorino-58cd955675-59598" Jul 10 20:32:22.924897 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:22.924857 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrnck\" (UniqueName: \"kubernetes.io/projected/a5c6f427-5082-4281-bda2-092299ecf3ae-kube-api-access-qrnck\") pod \"authorino-58cd955675-59598\" (UID: \"a5c6f427-5082-4281-bda2-092299ecf3ae\") " pod="kuadrant-system/authorino-58cd955675-59598" Jul 10 20:32:22.925160 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:22.924911 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnk9p\" (UniqueName: \"kubernetes.io/projected/2f2545bf-7f65-4009-8386-1c95404e76f1-kube-api-access-tnk9p\") pod \"authorino-75d556bd77-dpxds\" (UID: \"2f2545bf-7f65-4009-8386-1c95404e76f1\") " pod="kuadrant-system/authorino-75d556bd77-dpxds" Jul 10 20:32:22.933432 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:22.933408 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrnck\" (UniqueName: \"kubernetes.io/projected/a5c6f427-5082-4281-bda2-092299ecf3ae-kube-api-access-qrnck\") pod \"authorino-58cd955675-59598\" (UID: \"a5c6f427-5082-4281-bda2-092299ecf3ae\") " pod="kuadrant-system/authorino-58cd955675-59598" Jul 10 20:32:22.940968 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:22.940948 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-59598" Jul 10 20:32:23.025580 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:23.025542 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnk9p\" (UniqueName: \"kubernetes.io/projected/2f2545bf-7f65-4009-8386-1c95404e76f1-kube-api-access-tnk9p\") pod \"authorino-75d556bd77-dpxds\" (UID: \"2f2545bf-7f65-4009-8386-1c95404e76f1\") " pod="kuadrant-system/authorino-75d556bd77-dpxds" Jul 10 20:32:23.038235 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:23.037016 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnk9p\" (UniqueName: \"kubernetes.io/projected/2f2545bf-7f65-4009-8386-1c95404e76f1-kube-api-access-tnk9p\") pod \"authorino-75d556bd77-dpxds\" (UID: \"2f2545bf-7f65-4009-8386-1c95404e76f1\") " pod="kuadrant-system/authorino-75d556bd77-dpxds" Jul 10 20:32:23.104828 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:23.104764 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-59598"] Jul 10 20:32:23.106694 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:32:23.106670 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5c6f427_5082_4281_bda2_092299ecf3ae.slice/crio-7edd18ceea5ad6b08e7fba77afa1276fbb9d8f1fd7ccd223790c9048b83ddfb7 WatchSource:0}: Error finding container 7edd18ceea5ad6b08e7fba77afa1276fbb9d8f1fd7ccd223790c9048b83ddfb7: Status 404 returned error can't find the container with id 7edd18ceea5ad6b08e7fba77afa1276fbb9d8f1fd7ccd223790c9048b83ddfb7 Jul 10 20:32:23.117300 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:23.117278 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dpxds" Jul 10 20:32:23.252984 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:23.252958 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dpxds"] Jul 10 20:32:23.255027 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:32:23.254999 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f2545bf_7f65_4009_8386_1c95404e76f1.slice/crio-c9614e857e950ab391288377180f14dad234d451ac97d87e5dd89036c417a4f4 WatchSource:0}: Error finding container c9614e857e950ab391288377180f14dad234d451ac97d87e5dd89036c417a4f4: Status 404 returned error can't find the container with id c9614e857e950ab391288377180f14dad234d451ac97d87e5dd89036c417a4f4 Jul 10 20:32:23.504545 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:23.504460 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-59598" event={"ID":"a5c6f427-5082-4281-bda2-092299ecf3ae","Type":"ContainerStarted","Data":"7edd18ceea5ad6b08e7fba77afa1276fbb9d8f1fd7ccd223790c9048b83ddfb7"} Jul 10 20:32:23.505631 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:23.505608 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dpxds" event={"ID":"2f2545bf-7f65-4009-8386-1c95404e76f1","Type":"ContainerStarted","Data":"c9614e857e950ab391288377180f14dad234d451ac97d87e5dd89036c417a4f4"} Jul 10 20:32:27.531321 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:27.531287 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-59598" event={"ID":"a5c6f427-5082-4281-bda2-092299ecf3ae","Type":"ContainerStarted","Data":"058540b785ef45cf22c2aaae3bea8aba03f4bc6a6b101bfa82963093cca73c2d"} Jul 10 20:32:27.532772 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:27.532746 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dpxds" event={"ID":"2f2545bf-7f65-4009-8386-1c95404e76f1","Type":"ContainerStarted","Data":"b3de437cb67048bd0f08e7c8f047f57682dc20be2f5e81ca50d9f4675c463b53"} Jul 10 20:32:27.545949 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:27.545899 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-59598" podStartSLOduration=1.664540911 podStartE2EDuration="5.545885784s" totalImagesPullingTime="3.881344873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:32:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:32:27.543743015 +0000 UTC m=+669.003947837" watchObservedRunningTime="2026-07-10 20:32:27.545885784 +0000 UTC m=+669.006090610" Jul 10 20:32:27.558227 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:27.558176 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-dpxds" podStartSLOduration=1.81415903 podStartE2EDuration="5.55815948s" totalImagesPullingTime="3.74400045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:32:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:32:27.557039301 +0000 UTC m=+669.017244130" watchObservedRunningTime="2026-07-10 20:32:27.55815948 +0000 UTC m=+669.018364306" Jul 10 20:32:27.580853 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:27.580816 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-59598"] Jul 10 20:32:29.543022 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:29.542981 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-59598" podUID="a5c6f427-5082-4281-bda2-092299ecf3ae" containerName="authorino" containerID="cri-o://058540b785ef45cf22c2aaae3bea8aba03f4bc6a6b101bfa82963093cca73c2d" gracePeriod=30 Jul 10 20:32:29.798475 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:29.798418 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-59598" Jul 10 20:32:29.883305 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:29.883268 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrnck\" (UniqueName: \"kubernetes.io/projected/a5c6f427-5082-4281-bda2-092299ecf3ae-kube-api-access-qrnck\") pod \"a5c6f427-5082-4281-bda2-092299ecf3ae\" (UID: \"a5c6f427-5082-4281-bda2-092299ecf3ae\") " Jul 10 20:32:29.885428 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:29.885400 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5c6f427-5082-4281-bda2-092299ecf3ae-kube-api-access-qrnck" (OuterVolumeSpecName: "kube-api-access-qrnck") pod "a5c6f427-5082-4281-bda2-092299ecf3ae" (UID: "a5c6f427-5082-4281-bda2-092299ecf3ae"). InnerVolumeSpecName "kube-api-access-qrnck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:32:29.984060 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:29.984023 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrnck\" (UniqueName: \"kubernetes.io/projected/a5c6f427-5082-4281-bda2-092299ecf3ae-kube-api-access-qrnck\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:32:30.548630 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:30.548592 2580 generic.go:356] "Generic (PLEG): container finished" podID="a5c6f427-5082-4281-bda2-092299ecf3ae" containerID="058540b785ef45cf22c2aaae3bea8aba03f4bc6a6b101bfa82963093cca73c2d" exitCode=0 Jul 10 20:32:30.549076 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:30.548636 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-59598" Jul 10 20:32:30.549076 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:30.548637 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-59598" event={"ID":"a5c6f427-5082-4281-bda2-092299ecf3ae","Type":"ContainerDied","Data":"058540b785ef45cf22c2aaae3bea8aba03f4bc6a6b101bfa82963093cca73c2d"} Jul 10 20:32:30.549076 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:30.548680 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-59598" event={"ID":"a5c6f427-5082-4281-bda2-092299ecf3ae","Type":"ContainerDied","Data":"7edd18ceea5ad6b08e7fba77afa1276fbb9d8f1fd7ccd223790c9048b83ddfb7"} Jul 10 20:32:30.549076 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:30.548702 2580 scope.go:117] "RemoveContainer" containerID="058540b785ef45cf22c2aaae3bea8aba03f4bc6a6b101bfa82963093cca73c2d" Jul 10 20:32:30.557552 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:30.557530 2580 scope.go:117] "RemoveContainer" containerID="058540b785ef45cf22c2aaae3bea8aba03f4bc6a6b101bfa82963093cca73c2d" Jul 10 20:32:30.557797 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:32:30.557779 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"058540b785ef45cf22c2aaae3bea8aba03f4bc6a6b101bfa82963093cca73c2d\": container with ID starting with 058540b785ef45cf22c2aaae3bea8aba03f4bc6a6b101bfa82963093cca73c2d not found: ID does not exist" containerID="058540b785ef45cf22c2aaae3bea8aba03f4bc6a6b101bfa82963093cca73c2d" Jul 10 20:32:30.557852 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:30.557804 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"058540b785ef45cf22c2aaae3bea8aba03f4bc6a6b101bfa82963093cca73c2d"} err="failed to get container status \"058540b785ef45cf22c2aaae3bea8aba03f4bc6a6b101bfa82963093cca73c2d\": rpc error: code = NotFound desc = could not find container \"058540b785ef45cf22c2aaae3bea8aba03f4bc6a6b101bfa82963093cca73c2d\": container with ID starting with 058540b785ef45cf22c2aaae3bea8aba03f4bc6a6b101bfa82963093cca73c2d not found: ID does not exist" Jul 10 20:32:30.569103 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:30.569080 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-59598"] Jul 10 20:32:30.572349 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:30.572328 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-59598"] Jul 10 20:32:31.660370 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:31.660342 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5c6f427-5082-4281-bda2-092299ecf3ae" path="/var/lib/kubelet/pods/a5c6f427-5082-4281-bda2-092299ecf3ae/volumes" Jul 10 20:32:55.936436 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:55.936401 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-prpb5"] Jul 10 20:32:55.936937 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:55.936751 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5c6f427-5082-4281-bda2-092299ecf3ae" containerName="authorino" Jul 10 20:32:55.936937 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:55.936763 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5c6f427-5082-4281-bda2-092299ecf3ae" containerName="authorino" Jul 10 20:32:55.936937 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:55.936839 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5c6f427-5082-4281-bda2-092299ecf3ae" containerName="authorino" Jul 10 20:32:55.940003 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:55.939985 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-prpb5" Jul 10 20:32:55.948980 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:55.948953 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-prpb5"] Jul 10 20:32:56.017838 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.017800 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxcsb\" (UniqueName: \"kubernetes.io/projected/4ee4cea9-63e6-40b7-90cb-9c13f3d41d46-kube-api-access-vxcsb\") pod \"authorino-5d4b67c446-prpb5\" (UID: \"4ee4cea9-63e6-40b7-90cb-9c13f3d41d46\") " pod="kuadrant-system/authorino-5d4b67c446-prpb5" Jul 10 20:32:56.118866 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.118825 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxcsb\" (UniqueName: \"kubernetes.io/projected/4ee4cea9-63e6-40b7-90cb-9c13f3d41d46-kube-api-access-vxcsb\") pod \"authorino-5d4b67c446-prpb5\" (UID: \"4ee4cea9-63e6-40b7-90cb-9c13f3d41d46\") " pod="kuadrant-system/authorino-5d4b67c446-prpb5" Jul 10 20:32:56.128030 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.127996 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxcsb\" (UniqueName: \"kubernetes.io/projected/4ee4cea9-63e6-40b7-90cb-9c13f3d41d46-kube-api-access-vxcsb\") pod \"authorino-5d4b67c446-prpb5\" (UID: \"4ee4cea9-63e6-40b7-90cb-9c13f3d41d46\") " pod="kuadrant-system/authorino-5d4b67c446-prpb5" Jul 10 20:32:56.186522 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.186433 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-prpb5"] Jul 10 20:32:56.186697 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.186685 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-prpb5" Jul 10 20:32:56.215399 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.215366 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9975c446f-vdtwk"] Jul 10 20:32:56.219031 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.219006 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9975c446f-vdtwk" Jul 10 20:32:56.225894 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.225866 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9975c446f-vdtwk"] Jul 10 20:32:56.320588 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.320553 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bsm2\" (UniqueName: \"kubernetes.io/projected/b0b2983a-d916-43cf-b3d3-552c8c941e73-kube-api-access-7bsm2\") pod \"authorino-9975c446f-vdtwk\" (UID: \"b0b2983a-d916-43cf-b3d3-552c8c941e73\") " pod="kuadrant-system/authorino-9975c446f-vdtwk" Jul 10 20:32:56.326109 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.326072 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-prpb5"] Jul 10 20:32:56.328350 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:32:56.328327 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ee4cea9_63e6_40b7_90cb_9c13f3d41d46.slice/crio-0aece0cf5f683e638f6460cec5b3d172fec259479e33e0f915875721a72bf281 WatchSource:0}: Error finding container 0aece0cf5f683e638f6460cec5b3d172fec259479e33e0f915875721a72bf281: Status 404 returned error can't find the container with id 0aece0cf5f683e638f6460cec5b3d172fec259479e33e0f915875721a72bf281 Jul 10 20:32:56.364185 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.364124 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9975c446f-vdtwk"] Jul 10 20:32:56.364435 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:32:56.364416 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-7bsm2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-9975c446f-vdtwk" podUID="b0b2983a-d916-43cf-b3d3-552c8c941e73" Jul 10 20:32:56.393703 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.393668 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d9d97657c-kts2g"] Jul 10 20:32:56.397465 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.397439 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d9d97657c-kts2g" Jul 10 20:32:56.400011 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.399986 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 10 20:32:56.401422 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.401399 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d9d97657c-kts2g"] Jul 10 20:32:56.422020 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.421977 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bsm2\" (UniqueName: \"kubernetes.io/projected/b0b2983a-d916-43cf-b3d3-552c8c941e73-kube-api-access-7bsm2\") pod \"authorino-9975c446f-vdtwk\" (UID: \"b0b2983a-d916-43cf-b3d3-552c8c941e73\") " pod="kuadrant-system/authorino-9975c446f-vdtwk" Jul 10 20:32:56.431059 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.431027 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bsm2\" (UniqueName: \"kubernetes.io/projected/b0b2983a-d916-43cf-b3d3-552c8c941e73-kube-api-access-7bsm2\") pod \"authorino-9975c446f-vdtwk\" (UID: \"b0b2983a-d916-43cf-b3d3-552c8c941e73\") " pod="kuadrant-system/authorino-9975c446f-vdtwk" Jul 10 20:32:56.523447 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.523364 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32f4a8e4-f8bd-40fb-9ba0-0d16885d9629-tls-cert\") pod \"authorino-6d9d97657c-kts2g\" (UID: \"32f4a8e4-f8bd-40fb-9ba0-0d16885d9629\") " pod="kuadrant-system/authorino-6d9d97657c-kts2g" Jul 10 20:32:56.523447 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.523418 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzfvx\" (UniqueName: \"kubernetes.io/projected/32f4a8e4-f8bd-40fb-9ba0-0d16885d9629-kube-api-access-kzfvx\") pod \"authorino-6d9d97657c-kts2g\" (UID: \"32f4a8e4-f8bd-40fb-9ba0-0d16885d9629\") " pod="kuadrant-system/authorino-6d9d97657c-kts2g" Jul 10 20:32:56.624353 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.624315 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzfvx\" (UniqueName: \"kubernetes.io/projected/32f4a8e4-f8bd-40fb-9ba0-0d16885d9629-kube-api-access-kzfvx\") pod \"authorino-6d9d97657c-kts2g\" (UID: \"32f4a8e4-f8bd-40fb-9ba0-0d16885d9629\") " pod="kuadrant-system/authorino-6d9d97657c-kts2g" Jul 10 20:32:56.624550 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.624386 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32f4a8e4-f8bd-40fb-9ba0-0d16885d9629-tls-cert\") pod \"authorino-6d9d97657c-kts2g\" (UID: \"32f4a8e4-f8bd-40fb-9ba0-0d16885d9629\") " pod="kuadrant-system/authorino-6d9d97657c-kts2g" Jul 10 20:32:56.626736 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.626717 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32f4a8e4-f8bd-40fb-9ba0-0d16885d9629-tls-cert\") pod \"authorino-6d9d97657c-kts2g\" (UID: \"32f4a8e4-f8bd-40fb-9ba0-0d16885d9629\") " pod="kuadrant-system/authorino-6d9d97657c-kts2g" Jul 10 20:32:56.632785 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.632765 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzfvx\" (UniqueName: \"kubernetes.io/projected/32f4a8e4-f8bd-40fb-9ba0-0d16885d9629-kube-api-access-kzfvx\") pod \"authorino-6d9d97657c-kts2g\" (UID: \"32f4a8e4-f8bd-40fb-9ba0-0d16885d9629\") " pod="kuadrant-system/authorino-6d9d97657c-kts2g" Jul 10 20:32:56.683775 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.683739 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-prpb5" event={"ID":"4ee4cea9-63e6-40b7-90cb-9c13f3d41d46","Type":"ContainerStarted","Data":"0aece0cf5f683e638f6460cec5b3d172fec259479e33e0f915875721a72bf281"} Jul 10 20:32:56.683775 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.683758 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9975c446f-vdtwk" Jul 10 20:32:56.692001 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.691978 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9975c446f-vdtwk" Jul 10 20:32:56.708952 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.708928 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d9d97657c-kts2g" Jul 10 20:32:56.826651 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.826616 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bsm2\" (UniqueName: \"kubernetes.io/projected/b0b2983a-d916-43cf-b3d3-552c8c941e73-kube-api-access-7bsm2\") pod \"b0b2983a-d916-43cf-b3d3-552c8c941e73\" (UID: \"b0b2983a-d916-43cf-b3d3-552c8c941e73\") " Jul 10 20:32:56.829070 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.829042 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b2983a-d916-43cf-b3d3-552c8c941e73-kube-api-access-7bsm2" (OuterVolumeSpecName: "kube-api-access-7bsm2") pod "b0b2983a-d916-43cf-b3d3-552c8c941e73" (UID: "b0b2983a-d916-43cf-b3d3-552c8c941e73"). InnerVolumeSpecName "kube-api-access-7bsm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:32:56.850489 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.850463 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d9d97657c-kts2g"] Jul 10 20:32:56.853771 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:32:56.853745 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32f4a8e4_f8bd_40fb_9ba0_0d16885d9629.slice/crio-da292267fd811d500e0a05360322b3a93fbe1eb1bdb9cec437ea4210649b0921 WatchSource:0}: Error finding container da292267fd811d500e0a05360322b3a93fbe1eb1bdb9cec437ea4210649b0921: Status 404 returned error can't find the container with id da292267fd811d500e0a05360322b3a93fbe1eb1bdb9cec437ea4210649b0921 Jul 10 20:32:56.927596 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:56.927559 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bsm2\" (UniqueName: \"kubernetes.io/projected/b0b2983a-d916-43cf-b3d3-552c8c941e73-kube-api-access-7bsm2\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:32:57.690249 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:57.690210 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-prpb5" event={"ID":"4ee4cea9-63e6-40b7-90cb-9c13f3d41d46","Type":"ContainerStarted","Data":"7c71e945269d1c96d6da9ddc334e286c69dc3bd0f00d7077d9d932d164025e37"} Jul 10 20:32:57.690692 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:57.690247 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-prpb5" podUID="4ee4cea9-63e6-40b7-90cb-9c13f3d41d46" containerName="authorino" containerID="cri-o://7c71e945269d1c96d6da9ddc334e286c69dc3bd0f00d7077d9d932d164025e37" gracePeriod=30 Jul 10 20:32:57.691796 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:57.691769 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9975c446f-vdtwk" Jul 10 20:32:57.691903 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:57.691816 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d9d97657c-kts2g" event={"ID":"32f4a8e4-f8bd-40fb-9ba0-0d16885d9629","Type":"ContainerStarted","Data":"b5b7d7657d5b69472b119991bcd18f31de51072e64654cc2446ef0d02e345a2c"} Jul 10 20:32:57.691903 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:57.691851 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d9d97657c-kts2g" event={"ID":"32f4a8e4-f8bd-40fb-9ba0-0d16885d9629","Type":"ContainerStarted","Data":"da292267fd811d500e0a05360322b3a93fbe1eb1bdb9cec437ea4210649b0921"} Jul 10 20:32:57.706444 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:57.706392 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-prpb5" podStartSLOduration=2.333241081 podStartE2EDuration="2.706373563s" totalImagesPullingTime="373.132482ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:32:57.705920556 +0000 UTC m=+699.166125382" watchObservedRunningTime="2026-07-10 20:32:57.706373563 +0000 UTC m=+699.166578390" Jul 10 20:32:57.722680 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:57.722631 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d9d97657c-kts2g" podStartSLOduration=1.350547743 podStartE2EDuration="1.722613344s" totalImagesPullingTime="372.065601ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:32:57.721090125 +0000 UTC m=+699.181294952" watchObservedRunningTime="2026-07-10 20:32:57.722613344 +0000 UTC m=+699.182818170" Jul 10 20:32:57.750095 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:57.750063 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dpxds"] Jul 10 20:32:57.750284 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:57.750263 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-dpxds" podUID="2f2545bf-7f65-4009-8386-1c95404e76f1" containerName="authorino" containerID="cri-o://b3de437cb67048bd0f08e7c8f047f57682dc20be2f5e81ca50d9f4675c463b53" gracePeriod=30 Jul 10 20:32:57.757370 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:57.757345 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-9975c446f-vdtwk"] Jul 10 20:32:57.765370 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:57.765339 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-9975c446f-vdtwk"] Jul 10 20:32:58.012151 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.012102 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-prpb5" Jul 10 20:32:58.021907 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.018655 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dpxds" Jul 10 20:32:58.140063 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.140026 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnk9p\" (UniqueName: \"kubernetes.io/projected/2f2545bf-7f65-4009-8386-1c95404e76f1-kube-api-access-tnk9p\") pod \"2f2545bf-7f65-4009-8386-1c95404e76f1\" (UID: \"2f2545bf-7f65-4009-8386-1c95404e76f1\") " Jul 10 20:32:58.140219 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.140174 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxcsb\" (UniqueName: \"kubernetes.io/projected/4ee4cea9-63e6-40b7-90cb-9c13f3d41d46-kube-api-access-vxcsb\") pod \"4ee4cea9-63e6-40b7-90cb-9c13f3d41d46\" (UID: \"4ee4cea9-63e6-40b7-90cb-9c13f3d41d46\") " Jul 10 20:32:58.142156 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.142110 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ee4cea9-63e6-40b7-90cb-9c13f3d41d46-kube-api-access-vxcsb" (OuterVolumeSpecName: "kube-api-access-vxcsb") pod "4ee4cea9-63e6-40b7-90cb-9c13f3d41d46" (UID: "4ee4cea9-63e6-40b7-90cb-9c13f3d41d46"). InnerVolumeSpecName "kube-api-access-vxcsb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:32:58.142270 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.142185 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f2545bf-7f65-4009-8386-1c95404e76f1-kube-api-access-tnk9p" (OuterVolumeSpecName: "kube-api-access-tnk9p") pod "2f2545bf-7f65-4009-8386-1c95404e76f1" (UID: "2f2545bf-7f65-4009-8386-1c95404e76f1"). InnerVolumeSpecName "kube-api-access-tnk9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:32:58.240971 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.240882 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxcsb\" (UniqueName: \"kubernetes.io/projected/4ee4cea9-63e6-40b7-90cb-9c13f3d41d46-kube-api-access-vxcsb\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:32:58.240971 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.240916 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnk9p\" (UniqueName: \"kubernetes.io/projected/2f2545bf-7f65-4009-8386-1c95404e76f1-kube-api-access-tnk9p\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:32:58.698096 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.698065 2580 generic.go:356] "Generic (PLEG): container finished" podID="2f2545bf-7f65-4009-8386-1c95404e76f1" containerID="b3de437cb67048bd0f08e7c8f047f57682dc20be2f5e81ca50d9f4675c463b53" exitCode=0 Jul 10 20:32:58.698542 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.698105 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dpxds" Jul 10 20:32:58.698542 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.698156 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dpxds" event={"ID":"2f2545bf-7f65-4009-8386-1c95404e76f1","Type":"ContainerDied","Data":"b3de437cb67048bd0f08e7c8f047f57682dc20be2f5e81ca50d9f4675c463b53"} Jul 10 20:32:58.698542 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.698198 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dpxds" event={"ID":"2f2545bf-7f65-4009-8386-1c95404e76f1","Type":"ContainerDied","Data":"c9614e857e950ab391288377180f14dad234d451ac97d87e5dd89036c417a4f4"} Jul 10 20:32:58.698542 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.698215 2580 scope.go:117] "RemoveContainer" containerID="b3de437cb67048bd0f08e7c8f047f57682dc20be2f5e81ca50d9f4675c463b53" Jul 10 20:32:58.699626 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.699606 2580 generic.go:356] "Generic (PLEG): container finished" podID="4ee4cea9-63e6-40b7-90cb-9c13f3d41d46" containerID="7c71e945269d1c96d6da9ddc334e286c69dc3bd0f00d7077d9d932d164025e37" exitCode=0 Jul 10 20:32:58.699705 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.699660 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-prpb5" Jul 10 20:32:58.699766 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.699702 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-prpb5" event={"ID":"4ee4cea9-63e6-40b7-90cb-9c13f3d41d46","Type":"ContainerDied","Data":"7c71e945269d1c96d6da9ddc334e286c69dc3bd0f00d7077d9d932d164025e37"} Jul 10 20:32:58.699766 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.699757 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-prpb5" event={"ID":"4ee4cea9-63e6-40b7-90cb-9c13f3d41d46","Type":"ContainerDied","Data":"0aece0cf5f683e638f6460cec5b3d172fec259479e33e0f915875721a72bf281"} Jul 10 20:32:58.707994 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.707971 2580 scope.go:117] "RemoveContainer" containerID="b3de437cb67048bd0f08e7c8f047f57682dc20be2f5e81ca50d9f4675c463b53" Jul 10 20:32:58.708315 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:32:58.708294 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3de437cb67048bd0f08e7c8f047f57682dc20be2f5e81ca50d9f4675c463b53\": container with ID starting with b3de437cb67048bd0f08e7c8f047f57682dc20be2f5e81ca50d9f4675c463b53 not found: ID does not exist" containerID="b3de437cb67048bd0f08e7c8f047f57682dc20be2f5e81ca50d9f4675c463b53" Jul 10 20:32:58.708390 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.708325 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3de437cb67048bd0f08e7c8f047f57682dc20be2f5e81ca50d9f4675c463b53"} err="failed to get container status \"b3de437cb67048bd0f08e7c8f047f57682dc20be2f5e81ca50d9f4675c463b53\": rpc error: code = NotFound desc = could not find container \"b3de437cb67048bd0f08e7c8f047f57682dc20be2f5e81ca50d9f4675c463b53\": container with ID starting with b3de437cb67048bd0f08e7c8f047f57682dc20be2f5e81ca50d9f4675c463b53 not found: ID does not exist" Jul 10 20:32:58.708390 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.708348 2580 scope.go:117] "RemoveContainer" containerID="7c71e945269d1c96d6da9ddc334e286c69dc3bd0f00d7077d9d932d164025e37" Jul 10 20:32:58.716561 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.716542 2580 scope.go:117] "RemoveContainer" containerID="7c71e945269d1c96d6da9ddc334e286c69dc3bd0f00d7077d9d932d164025e37" Jul 10 20:32:58.716821 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:32:58.716801 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c71e945269d1c96d6da9ddc334e286c69dc3bd0f00d7077d9d932d164025e37\": container with ID starting with 7c71e945269d1c96d6da9ddc334e286c69dc3bd0f00d7077d9d932d164025e37 not found: ID does not exist" containerID="7c71e945269d1c96d6da9ddc334e286c69dc3bd0f00d7077d9d932d164025e37" Jul 10 20:32:58.716884 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.716827 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c71e945269d1c96d6da9ddc334e286c69dc3bd0f00d7077d9d932d164025e37"} err="failed to get container status \"7c71e945269d1c96d6da9ddc334e286c69dc3bd0f00d7077d9d932d164025e37\": rpc error: code = NotFound desc = could not find container \"7c71e945269d1c96d6da9ddc334e286c69dc3bd0f00d7077d9d932d164025e37\": container with ID starting with 7c71e945269d1c96d6da9ddc334e286c69dc3bd0f00d7077d9d932d164025e37 not found: ID does not exist" Jul 10 20:32:58.722488 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.722464 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-prpb5"] Jul 10 20:32:58.727486 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.727461 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-prpb5"] Jul 10 20:32:58.737455 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.737428 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dpxds"] Jul 10 20:32:58.740785 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:58.740764 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dpxds"] Jul 10 20:32:59.660769 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:59.660737 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f2545bf-7f65-4009-8386-1c95404e76f1" path="/var/lib/kubelet/pods/2f2545bf-7f65-4009-8386-1c95404e76f1/volumes" Jul 10 20:32:59.661140 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:59.661109 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ee4cea9-63e6-40b7-90cb-9c13f3d41d46" path="/var/lib/kubelet/pods/4ee4cea9-63e6-40b7-90cb-9c13f3d41d46/volumes" Jul 10 20:32:59.661462 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:32:59.661447 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0b2983a-d916-43cf-b3d3-552c8c941e73" path="/var/lib/kubelet/pods/b0b2983a-d916-43cf-b3d3-552c8c941e73/volumes" Jul 10 20:33:55.809744 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.809709 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w"] Jul 10 20:33:55.810228 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.810087 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee4cea9-63e6-40b7-90cb-9c13f3d41d46" containerName="authorino" Jul 10 20:33:55.810228 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.810098 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee4cea9-63e6-40b7-90cb-9c13f3d41d46" containerName="authorino" Jul 10 20:33:55.810228 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.810112 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f2545bf-7f65-4009-8386-1c95404e76f1" containerName="authorino" Jul 10 20:33:55.810228 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.810118 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f2545bf-7f65-4009-8386-1c95404e76f1" containerName="authorino" Jul 10 20:33:55.810228 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.810219 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee4cea9-63e6-40b7-90cb-9c13f3d41d46" containerName="authorino" Jul 10 20:33:55.810394 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.810233 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f2545bf-7f65-4009-8386-1c95404e76f1" containerName="authorino" Jul 10 20:33:55.812770 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.812750 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:55.815233 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.815182 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 20:33:55.815366 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.815350 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 20:33:55.816094 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.816077 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 10 20:33:55.816164 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.816117 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tmx44\"" Jul 10 20:33:55.823861 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.823836 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w"] Jul 10 20:33:55.933006 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.932955 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:55.933203 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.933026 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npl8b\" (UniqueName: \"kubernetes.io/projected/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-kube-api-access-npl8b\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:55.933203 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.933107 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:55.933203 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.933180 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:55.933321 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.933214 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:55.933321 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:55.933229 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:56.034656 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:56.034610 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:56.034656 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:56.034662 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:56.034913 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:56.034783 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:56.034913 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:56.034841 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:56.035023 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:56.034913 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npl8b\" (UniqueName: \"kubernetes.io/projected/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-kube-api-access-npl8b\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:56.035023 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:56.034964 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:56.035167 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:56.035083 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:56.035265 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:56.035239 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:56.035403 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:56.035268 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:56.036967 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:56.036947 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:56.037355 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:56.037336 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:56.042848 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:56.042824 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-npl8b\" (UniqueName: \"kubernetes.io/projected/4549e5a9-b631-4fc9-9e45-b2e18f9c30b1-kube-api-access-npl8b\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w\" (UID: \"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:56.123045 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:56.122954 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:33:56.259790 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:56.259765 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w"] Jul 10 20:33:56.261468 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:33:56.261438 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4549e5a9_b631_4fc9_9e45_b2e18f9c30b1.slice/crio-5861d96ad9cd9781bca5e4c9906c731c12f2e1986fdccbf3bb3d4e9c5c28ad08 WatchSource:0}: Error finding container 5861d96ad9cd9781bca5e4c9906c731c12f2e1986fdccbf3bb3d4e9c5c28ad08: Status 404 returned error can't find the container with id 5861d96ad9cd9781bca5e4c9906c731c12f2e1986fdccbf3bb3d4e9c5c28ad08 Jul 10 20:33:56.262886 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:56.262870 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 20:33:57.008914 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:57.008872 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" event={"ID":"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1","Type":"ContainerStarted","Data":"5861d96ad9cd9781bca5e4c9906c731c12f2e1986fdccbf3bb3d4e9c5c28ad08"} Jul 10 20:33:58.015817 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:58.015784 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" event={"ID":"4549e5a9-b631-4fc9-9e45-b2e18f9c30b1","Type":"ContainerStarted","Data":"72c298a0ee828ce584a5a456e88d0c52f288ff003691b713c93fefec77f38b9a"} Jul 10 20:33:58.035814 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:33:58.035759 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" podStartSLOduration=1.873639337 podStartE2EDuration="3.035742339s" totalImagesPullingTime="1.162103002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:33:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:33:58.032797315 +0000 UTC m=+759.493002141" watchObservedRunningTime="2026-07-10 20:33:58.035742339 +0000 UTC m=+759.495947168" Jul 10 20:34:06.123969 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:06.123917 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:34:06.124601 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:06.123998 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:34:06.136573 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:06.136547 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:34:07.077119 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:07.077085 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w" Jul 10 20:34:29.515692 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.515658 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w"] Jul 10 20:34:29.522374 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.522355 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.525000 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.524967 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 10 20:34:29.529903 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.529875 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w"] Jul 10 20:34:29.636558 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.636515 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b73885cb-39cc-477c-9309-935e43ea1e10-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.636558 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.636565 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b73885cb-39cc-477c-9309-935e43ea1e10-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.636773 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.636638 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b73885cb-39cc-477c-9309-935e43ea1e10-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.636773 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.636673 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b73885cb-39cc-477c-9309-935e43ea1e10-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.636841 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.636778 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b73885cb-39cc-477c-9309-935e43ea1e10-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.636841 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.636813 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z9cw\" (UniqueName: \"kubernetes.io/projected/b73885cb-39cc-477c-9309-935e43ea1e10-kube-api-access-7z9cw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.737525 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.737483 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b73885cb-39cc-477c-9309-935e43ea1e10-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.737525 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.737540 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b73885cb-39cc-477c-9309-935e43ea1e10-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.737759 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.737585 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b73885cb-39cc-477c-9309-935e43ea1e10-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.737759 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.737612 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b73885cb-39cc-477c-9309-935e43ea1e10-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.737759 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.737708 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b73885cb-39cc-477c-9309-935e43ea1e10-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.737759 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.737742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z9cw\" (UniqueName: \"kubernetes.io/projected/b73885cb-39cc-477c-9309-935e43ea1e10-kube-api-access-7z9cw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.737955 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.737930 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b73885cb-39cc-477c-9309-935e43ea1e10-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.738015 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.737975 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b73885cb-39cc-477c-9309-935e43ea1e10-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.738145 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.738105 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b73885cb-39cc-477c-9309-935e43ea1e10-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.739924 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.739898 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b73885cb-39cc-477c-9309-935e43ea1e10-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.740094 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.740075 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b73885cb-39cc-477c-9309-935e43ea1e10-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.746446 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.746423 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z9cw\" (UniqueName: \"kubernetes.io/projected/b73885cb-39cc-477c-9309-935e43ea1e10-kube-api-access-7z9cw\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w\" (UID: \"b73885cb-39cc-477c-9309-935e43ea1e10\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.833043 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.832953 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:29.968016 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:29.967971 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w"] Jul 10 20:34:29.969233 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:34:29.969195 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb73885cb_39cc_477c_9309_935e43ea1e10.slice/crio-6841ab3d0b1913a2162941c5f81d1c422a1baf29dca10fd0dd441c7dd8f7e278 WatchSource:0}: Error finding container 6841ab3d0b1913a2162941c5f81d1c422a1baf29dca10fd0dd441c7dd8f7e278: Status 404 returned error can't find the container with id 6841ab3d0b1913a2162941c5f81d1c422a1baf29dca10fd0dd441c7dd8f7e278 Jul 10 20:34:30.189081 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:30.189045 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" event={"ID":"b73885cb-39cc-477c-9309-935e43ea1e10","Type":"ContainerStarted","Data":"6841ab3d0b1913a2162941c5f81d1c422a1baf29dca10fd0dd441c7dd8f7e278"} Jul 10 20:34:31.195367 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:31.195333 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" event={"ID":"b73885cb-39cc-477c-9309-935e43ea1e10","Type":"ContainerStarted","Data":"ed85a6a318ff0545972129d7e10eacadf361802effc0fb1734200dca5ace6be5"} Jul 10 20:34:31.211339 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:31.211292 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" podStartSLOduration=1.967914036 podStartE2EDuration="2.21127615s" totalImagesPullingTime="243.362114ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:34:31.209952167 +0000 UTC m=+792.670156995" watchObservedRunningTime="2026-07-10 20:34:31.21127615 +0000 UTC m=+792.671480976" Jul 10 20:34:39.833310 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:39.833271 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:39.833868 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:39.833355 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:39.845775 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:39.845754 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:34:40.257993 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:34:40.257965 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w" Jul 10 20:35:42.621229 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:42.621191 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69b8458b44-pzrxn"] Jul 10 20:35:42.624650 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:42.624632 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69b8458b44-pzrxn" Jul 10 20:35:42.633635 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:42.633607 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69b8458b44-pzrxn"] Jul 10 20:35:42.700109 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:42.700071 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/014e717d-5594-471b-b239-68810dee0395-tls-cert\") pod \"authorino-69b8458b44-pzrxn\" (UID: \"014e717d-5594-471b-b239-68810dee0395\") " pod="kuadrant-system/authorino-69b8458b44-pzrxn" Jul 10 20:35:42.700109 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:42.700114 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wwbs\" (UniqueName: \"kubernetes.io/projected/014e717d-5594-471b-b239-68810dee0395-kube-api-access-6wwbs\") pod \"authorino-69b8458b44-pzrxn\" (UID: \"014e717d-5594-471b-b239-68810dee0395\") " pod="kuadrant-system/authorino-69b8458b44-pzrxn" Jul 10 20:35:42.800931 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:42.800895 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/014e717d-5594-471b-b239-68810dee0395-tls-cert\") pod \"authorino-69b8458b44-pzrxn\" (UID: \"014e717d-5594-471b-b239-68810dee0395\") " pod="kuadrant-system/authorino-69b8458b44-pzrxn" Jul 10 20:35:42.801157 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:42.800950 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wwbs\" (UniqueName: \"kubernetes.io/projected/014e717d-5594-471b-b239-68810dee0395-kube-api-access-6wwbs\") pod \"authorino-69b8458b44-pzrxn\" (UID: \"014e717d-5594-471b-b239-68810dee0395\") " pod="kuadrant-system/authorino-69b8458b44-pzrxn" Jul 10 20:35:42.803384 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:42.803358 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/014e717d-5594-471b-b239-68810dee0395-tls-cert\") pod \"authorino-69b8458b44-pzrxn\" (UID: \"014e717d-5594-471b-b239-68810dee0395\") " pod="kuadrant-system/authorino-69b8458b44-pzrxn" Jul 10 20:35:42.808438 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:42.808414 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wwbs\" (UniqueName: \"kubernetes.io/projected/014e717d-5594-471b-b239-68810dee0395-kube-api-access-6wwbs\") pod \"authorino-69b8458b44-pzrxn\" (UID: \"014e717d-5594-471b-b239-68810dee0395\") " pod="kuadrant-system/authorino-69b8458b44-pzrxn" Jul 10 20:35:42.933771 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:42.933734 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69b8458b44-pzrxn" Jul 10 20:35:43.075664 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:43.075634 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69b8458b44-pzrxn"] Jul 10 20:35:43.076586 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:35:43.076562 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod014e717d_5594_471b_b239_68810dee0395.slice/crio-c7bb7df2dde87241f4a73f01dcedcad2e5c346cc8ac7a3efabd195f52cb47c81 WatchSource:0}: Error finding container c7bb7df2dde87241f4a73f01dcedcad2e5c346cc8ac7a3efabd195f52cb47c81: Status 404 returned error can't find the container with id c7bb7df2dde87241f4a73f01dcedcad2e5c346cc8ac7a3efabd195f52cb47c81 Jul 10 20:35:43.585537 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:43.585501 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69b8458b44-pzrxn" event={"ID":"014e717d-5594-471b-b239-68810dee0395","Type":"ContainerStarted","Data":"c7bb7df2dde87241f4a73f01dcedcad2e5c346cc8ac7a3efabd195f52cb47c81"} Jul 10 20:35:44.597198 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:44.597049 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69b8458b44-pzrxn" event={"ID":"014e717d-5594-471b-b239-68810dee0395","Type":"ContainerStarted","Data":"b1f46494e7d2aa5b232bedae716cb98e881ddf5122e2bc7f237456710c173386"} Jul 10 20:35:44.617975 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:44.617908 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-69b8458b44-pzrxn" podStartSLOduration=2.181777269 podStartE2EDuration="2.617891992s" totalImagesPullingTime="436.114723ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:35:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:35:44.616432813 +0000 UTC m=+866.076637639" watchObservedRunningTime="2026-07-10 20:35:44.617891992 +0000 UTC m=+866.078096861" Jul 10 20:35:44.645304 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:44.645206 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d9d97657c-kts2g"] Jul 10 20:35:44.645499 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:44.645431 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6d9d97657c-kts2g" podUID="32f4a8e4-f8bd-40fb-9ba0-0d16885d9629" containerName="authorino" containerID="cri-o://b5b7d7657d5b69472b119991bcd18f31de51072e64654cc2446ef0d02e345a2c" gracePeriod=30 Jul 10 20:35:44.918595 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:44.918568 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d9d97657c-kts2g" Jul 10 20:35:45.022789 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:45.022753 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzfvx\" (UniqueName: \"kubernetes.io/projected/32f4a8e4-f8bd-40fb-9ba0-0d16885d9629-kube-api-access-kzfvx\") pod \"32f4a8e4-f8bd-40fb-9ba0-0d16885d9629\" (UID: \"32f4a8e4-f8bd-40fb-9ba0-0d16885d9629\") " Jul 10 20:35:45.022987 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:45.022804 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32f4a8e4-f8bd-40fb-9ba0-0d16885d9629-tls-cert\") pod \"32f4a8e4-f8bd-40fb-9ba0-0d16885d9629\" (UID: \"32f4a8e4-f8bd-40fb-9ba0-0d16885d9629\") " Jul 10 20:35:45.025275 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:45.025238 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32f4a8e4-f8bd-40fb-9ba0-0d16885d9629-kube-api-access-kzfvx" (OuterVolumeSpecName: "kube-api-access-kzfvx") pod "32f4a8e4-f8bd-40fb-9ba0-0d16885d9629" (UID: "32f4a8e4-f8bd-40fb-9ba0-0d16885d9629"). InnerVolumeSpecName "kube-api-access-kzfvx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:35:45.033761 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:45.033729 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32f4a8e4-f8bd-40fb-9ba0-0d16885d9629-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "32f4a8e4-f8bd-40fb-9ba0-0d16885d9629" (UID: "32f4a8e4-f8bd-40fb-9ba0-0d16885d9629"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 20:35:45.123698 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:45.123660 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzfvx\" (UniqueName: \"kubernetes.io/projected/32f4a8e4-f8bd-40fb-9ba0-0d16885d9629-kube-api-access-kzfvx\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:35:45.123698 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:45.123694 2580 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/32f4a8e4-f8bd-40fb-9ba0-0d16885d9629-tls-cert\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:35:45.604081 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:45.604048 2580 generic.go:356] "Generic (PLEG): container finished" podID="32f4a8e4-f8bd-40fb-9ba0-0d16885d9629" containerID="b5b7d7657d5b69472b119991bcd18f31de51072e64654cc2446ef0d02e345a2c" exitCode=0 Jul 10 20:35:45.604535 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:45.604149 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d9d97657c-kts2g" Jul 10 20:35:45.604535 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:45.604154 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d9d97657c-kts2g" event={"ID":"32f4a8e4-f8bd-40fb-9ba0-0d16885d9629","Type":"ContainerDied","Data":"b5b7d7657d5b69472b119991bcd18f31de51072e64654cc2446ef0d02e345a2c"} Jul 10 20:35:45.604535 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:45.604203 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d9d97657c-kts2g" event={"ID":"32f4a8e4-f8bd-40fb-9ba0-0d16885d9629","Type":"ContainerDied","Data":"da292267fd811d500e0a05360322b3a93fbe1eb1bdb9cec437ea4210649b0921"} Jul 10 20:35:45.604535 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:45.604218 2580 scope.go:117] "RemoveContainer" containerID="b5b7d7657d5b69472b119991bcd18f31de51072e64654cc2446ef0d02e345a2c" Jul 10 20:35:45.614544 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:45.614520 2580 scope.go:117] "RemoveContainer" containerID="b5b7d7657d5b69472b119991bcd18f31de51072e64654cc2446ef0d02e345a2c" Jul 10 20:35:45.614816 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:35:45.614797 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5b7d7657d5b69472b119991bcd18f31de51072e64654cc2446ef0d02e345a2c\": container with ID starting with b5b7d7657d5b69472b119991bcd18f31de51072e64654cc2446ef0d02e345a2c not found: ID does not exist" containerID="b5b7d7657d5b69472b119991bcd18f31de51072e64654cc2446ef0d02e345a2c" Jul 10 20:35:45.614877 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:45.614825 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5b7d7657d5b69472b119991bcd18f31de51072e64654cc2446ef0d02e345a2c"} err="failed to get container status \"b5b7d7657d5b69472b119991bcd18f31de51072e64654cc2446ef0d02e345a2c\": rpc error: code = NotFound desc = could not find container \"b5b7d7657d5b69472b119991bcd18f31de51072e64654cc2446ef0d02e345a2c\": container with ID starting with b5b7d7657d5b69472b119991bcd18f31de51072e64654cc2446ef0d02e345a2c not found: ID does not exist" Jul 10 20:35:45.631980 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:45.631946 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d9d97657c-kts2g"] Jul 10 20:35:45.634442 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:45.634416 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d9d97657c-kts2g"] Jul 10 20:35:45.662476 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:35:45.662435 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32f4a8e4-f8bd-40fb-9ba0-0d16885d9629" path="/var/lib/kubelet/pods/32f4a8e4-f8bd-40fb-9ba0-0d16885d9629/volumes" Jul 10 20:36:19.589139 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:36:19.589109 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:36:19.591923 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:36:19.591905 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:41:19.635021 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:19.634993 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:41:19.639536 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:19.639514 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:41:44.784328 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:44.784292 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8"] Jul 10 20:41:44.784716 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:44.784511 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" podUID="427c1053-165f-4315-972d-de8c5276dd1c" containerName="manager" containerID="cri-o://4fa5a00e7c8ea8e504f8a242b99a0ee057f34a1e5b672d86e4ca75cf37f63918" gracePeriod=10 Jul 10 20:41:48.734012 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:48.733986 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" Jul 10 20:41:48.890629 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:48.890597 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg5hl\" (UniqueName: \"kubernetes.io/projected/427c1053-165f-4315-972d-de8c5276dd1c-kube-api-access-fg5hl\") pod \"427c1053-165f-4315-972d-de8c5276dd1c\" (UID: \"427c1053-165f-4315-972d-de8c5276dd1c\") " Jul 10 20:41:48.890801 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:48.890656 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/427c1053-165f-4315-972d-de8c5276dd1c-extensions-socket-volume\") pod \"427c1053-165f-4315-972d-de8c5276dd1c\" (UID: \"427c1053-165f-4315-972d-de8c5276dd1c\") " Jul 10 20:41:48.891004 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:48.890986 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/427c1053-165f-4315-972d-de8c5276dd1c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "427c1053-165f-4315-972d-de8c5276dd1c" (UID: "427c1053-165f-4315-972d-de8c5276dd1c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 20:41:48.892775 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:48.892745 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/427c1053-165f-4315-972d-de8c5276dd1c-kube-api-access-fg5hl" (OuterVolumeSpecName: "kube-api-access-fg5hl") pod "427c1053-165f-4315-972d-de8c5276dd1c" (UID: "427c1053-165f-4315-972d-de8c5276dd1c"). InnerVolumeSpecName "kube-api-access-fg5hl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 20:41:48.991900 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:48.991867 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg5hl\" (UniqueName: \"kubernetes.io/projected/427c1053-165f-4315-972d-de8c5276dd1c-kube-api-access-fg5hl\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:41:48.991900 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:48.991895 2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/427c1053-165f-4315-972d-de8c5276dd1c-extensions-socket-volume\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 20:41:49.598856 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:49.598820 2580 generic.go:356] "Generic (PLEG): container finished" podID="427c1053-165f-4315-972d-de8c5276dd1c" containerID="4fa5a00e7c8ea8e504f8a242b99a0ee057f34a1e5b672d86e4ca75cf37f63918" exitCode=0 Jul 10 20:41:49.598856 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:49.598859 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" Jul 10 20:41:49.599178 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:49.598904 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" event={"ID":"427c1053-165f-4315-972d-de8c5276dd1c","Type":"ContainerDied","Data":"4fa5a00e7c8ea8e504f8a242b99a0ee057f34a1e5b672d86e4ca75cf37f63918"} Jul 10 20:41:49.599178 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:49.598962 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8" event={"ID":"427c1053-165f-4315-972d-de8c5276dd1c","Type":"ContainerDied","Data":"b388b17c35ef01caaf1f43d161d7adf9821ec6d191c989b0297f6db8add628e5"} Jul 10 20:41:49.599178 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:49.598985 2580 scope.go:117] "RemoveContainer" containerID="4fa5a00e7c8ea8e504f8a242b99a0ee057f34a1e5b672d86e4ca75cf37f63918" Jul 10 20:41:49.609608 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:49.609582 2580 scope.go:117] "RemoveContainer" containerID="4fa5a00e7c8ea8e504f8a242b99a0ee057f34a1e5b672d86e4ca75cf37f63918" Jul 10 20:41:49.609899 ip-10-0-133-6 kubenswrapper[2580]: E0710 20:41:49.609875 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fa5a00e7c8ea8e504f8a242b99a0ee057f34a1e5b672d86e4ca75cf37f63918\": container with ID starting with 4fa5a00e7c8ea8e504f8a242b99a0ee057f34a1e5b672d86e4ca75cf37f63918 not found: ID does not exist" containerID="4fa5a00e7c8ea8e504f8a242b99a0ee057f34a1e5b672d86e4ca75cf37f63918" Jul 10 20:41:49.609985 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:49.609905 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fa5a00e7c8ea8e504f8a242b99a0ee057f34a1e5b672d86e4ca75cf37f63918"} err="failed to get container status \"4fa5a00e7c8ea8e504f8a242b99a0ee057f34a1e5b672d86e4ca75cf37f63918\": rpc error: code = NotFound desc = could not find container \"4fa5a00e7c8ea8e504f8a242b99a0ee057f34a1e5b672d86e4ca75cf37f63918\": container with ID starting with 4fa5a00e7c8ea8e504f8a242b99a0ee057f34a1e5b672d86e4ca75cf37f63918 not found: ID does not exist" Jul 10 20:41:49.621756 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:49.621727 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8"] Jul 10 20:41:49.625149 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:49.625111 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v9rm8"] Jul 10 20:41:49.660291 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:41:49.660260 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="427c1053-165f-4315-972d-de8c5276dd1c" path="/var/lib/kubelet/pods/427c1053-165f-4315-972d-de8c5276dd1c/volumes" Jul 10 20:42:45.899462 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:45.899425 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6g867"] Jul 10 20:42:45.899916 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:45.899802 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="427c1053-165f-4315-972d-de8c5276dd1c" containerName="manager" Jul 10 20:42:45.899916 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:45.899813 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="427c1053-165f-4315-972d-de8c5276dd1c" containerName="manager" Jul 10 20:42:45.899916 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:45.899832 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32f4a8e4-f8bd-40fb-9ba0-0d16885d9629" containerName="authorino" Jul 10 20:42:45.899916 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:45.899838 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="32f4a8e4-f8bd-40fb-9ba0-0d16885d9629" containerName="authorino" Jul 10 20:42:45.899916 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:45.899899 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="427c1053-165f-4315-972d-de8c5276dd1c" containerName="manager" Jul 10 20:42:45.899916 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:45.899909 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="32f4a8e4-f8bd-40fb-9ba0-0d16885d9629" containerName="authorino" Jul 10 20:42:45.903016 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:45.902995 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6g867" Jul 10 20:42:45.905578 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:45.905560 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-gbr7t\"" Jul 10 20:42:45.915494 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:45.915467 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6g867"] Jul 10 20:42:45.996832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:45.996795 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krpdj\" (UniqueName: \"kubernetes.io/projected/34d991c8-08a5-4bdc-9bad-97e5ab51b078-kube-api-access-krpdj\") pod \"kuadrant-operator-controller-manager-86878c769f-6g867\" (UID: \"34d991c8-08a5-4bdc-9bad-97e5ab51b078\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6g867" Jul 10 20:42:45.996832 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:45.996845 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34d991c8-08a5-4bdc-9bad-97e5ab51b078-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6g867\" (UID: \"34d991c8-08a5-4bdc-9bad-97e5ab51b078\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6g867" Jul 10 20:42:46.098100 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:46.098058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krpdj\" (UniqueName: \"kubernetes.io/projected/34d991c8-08a5-4bdc-9bad-97e5ab51b078-kube-api-access-krpdj\") pod \"kuadrant-operator-controller-manager-86878c769f-6g867\" (UID: \"34d991c8-08a5-4bdc-9bad-97e5ab51b078\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6g867" Jul 10 20:42:46.098100 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:46.098101 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34d991c8-08a5-4bdc-9bad-97e5ab51b078-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6g867\" (UID: \"34d991c8-08a5-4bdc-9bad-97e5ab51b078\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6g867" Jul 10 20:42:46.098532 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:46.098513 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/34d991c8-08a5-4bdc-9bad-97e5ab51b078-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-6g867\" (UID: \"34d991c8-08a5-4bdc-9bad-97e5ab51b078\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6g867" Jul 10 20:42:46.106913 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:46.106883 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krpdj\" (UniqueName: \"kubernetes.io/projected/34d991c8-08a5-4bdc-9bad-97e5ab51b078-kube-api-access-krpdj\") pod \"kuadrant-operator-controller-manager-86878c769f-6g867\" (UID: \"34d991c8-08a5-4bdc-9bad-97e5ab51b078\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6g867" Jul 10 20:42:46.213331 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:46.213244 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6g867" Jul 10 20:42:46.350232 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:46.350203 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6g867"] Jul 10 20:42:46.352110 ip-10-0-133-6 kubenswrapper[2580]: W0710 20:42:46.352087 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d991c8_08a5_4bdc_9bad_97e5ab51b078.slice/crio-10eb1e365dd7d938c6686355fa76e1d63f4775ef7890eb91b33332cd202885e2 WatchSource:0}: Error finding container 10eb1e365dd7d938c6686355fa76e1d63f4775ef7890eb91b33332cd202885e2: Status 404 returned error can't find the container with id 10eb1e365dd7d938c6686355fa76e1d63f4775ef7890eb91b33332cd202885e2 Jul 10 20:42:46.898983 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:46.898951 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6g867" event={"ID":"34d991c8-08a5-4bdc-9bad-97e5ab51b078","Type":"ContainerStarted","Data":"3529273e533a6fad737e0d6d63cccab6c5bd9180806b15aa766e1a432d79e7ad"} Jul 10 20:42:46.899175 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:46.899002 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6g867" event={"ID":"34d991c8-08a5-4bdc-9bad-97e5ab51b078","Type":"ContainerStarted","Data":"10eb1e365dd7d938c6686355fa76e1d63f4775ef7890eb91b33332cd202885e2"} Jul 10 20:42:46.899175 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:46.899033 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6g867" Jul 10 20:42:46.920234 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:46.920182 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6g867" podStartSLOduration=1.9201678690000001 podStartE2EDuration="1.920167869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 20:42:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 20:42:46.916749141 +0000 UTC m=+1288.376953967" watchObservedRunningTime="2026-07-10 20:42:46.920167869 +0000 UTC m=+1288.380372695" Jul 10 20:42:57.906977 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:42:57.906940 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-6g867" Jul 10 20:46:19.677076 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:46:19.677038 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:46:19.690002 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:46:19.689972 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:51:19.722921 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:51:19.722887 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:51:19.727949 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:51:19.727928 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:56:19.766726 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:56:19.766691 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 20:56:19.773742 ip-10-0-133-6 kubenswrapper[2580]: I0710 20:56:19.773721 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 21:00:00.133998 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.133956 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-28db1d-29728620-7ctpf"] Jul 10 21:00:00.137587 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.137566 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e560d0-29728620-kl2pp"] Jul 10 21:00:00.137695 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.137672 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-28db1d-29728620-7ctpf" Jul 10 21:00:00.140149 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.140115 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-tdxg6\"" Jul 10 21:00:00.140747 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.140732 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728620-ng7mk"] Jul 10 21:00:00.140855 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.140841 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e560d0-29728620-kl2pp" Jul 10 21:00:00.143899 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.143882 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728620-ng7mk" Jul 10 21:00:00.149187 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.149165 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-28db1d-29728620-7ctpf"] Jul 10 21:00:00.152116 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.152063 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728620-ng7mk"] Jul 10 21:00:00.152934 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.152916 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-28db1d-29728620-7ctpf" Jul 10 21:00:00.155423 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.155398 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e560d0-29728620-kl2pp"] Jul 10 21:00:00.161294 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.161272 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e560d0-29728620-kl2pp" Jul 10 21:00:00.191886 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.191860 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728620-ng7mk" Jul 10 21:00:00.326277 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.326254 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-28db1d-29728620-7ctpf"] Jul 10 21:00:00.328628 ip-10-0-133-6 kubenswrapper[2580]: W0710 21:00:00.328598 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34dffd42_71a8_41fb_9597_5cb26c60e807.slice/crio-bda0753e5d0a7832b46d031e6f06a2d98af23e17eb51a9106d35b0bf008c8e02 WatchSource:0}: Error finding container bda0753e5d0a7832b46d031e6f06a2d98af23e17eb51a9106d35b0bf008c8e02: Status 404 returned error can't find the container with id bda0753e5d0a7832b46d031e6f06a2d98af23e17eb51a9106d35b0bf008c8e02 Jul 10 21:00:00.331701 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.331680 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 21:00:00.370061 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.370035 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728620-ng7mk"] Jul 10 21:00:00.371608 ip-10-0-133-6 kubenswrapper[2580]: W0710 21:00:00.371582 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cc0360c_ef09_48ad_9aa9_8d6a6f6f5b4f.slice/crio-5a5d2ed0e2ad5e57d996ed142a3f0ef85761dd0d744686225bf2c6989ddf50ae WatchSource:0}: Error finding container 5a5d2ed0e2ad5e57d996ed142a3f0ef85761dd0d744686225bf2c6989ddf50ae: Status 404 returned error can't find the container with id 5a5d2ed0e2ad5e57d996ed142a3f0ef85761dd0d744686225bf2c6989ddf50ae Jul 10 21:00:00.499696 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.499603 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728620-ng7mk" event={"ID":"8cc0360c-ef09-48ad-9aa9-8d6a6f6f5b4f","Type":"ContainerStarted","Data":"5a5d2ed0e2ad5e57d996ed142a3f0ef85761dd0d744686225bf2c6989ddf50ae"} Jul 10 21:00:00.500670 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.500650 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-28db1d-29728620-7ctpf" event={"ID":"34dffd42-71a8-41fb-9597-5cb26c60e807","Type":"ContainerStarted","Data":"bda0753e5d0a7832b46d031e6f06a2d98af23e17eb51a9106d35b0bf008c8e02"} Jul 10 21:00:00.553355 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:00.553329 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e560d0-29728620-kl2pp"] Jul 10 21:00:00.554980 ip-10-0-133-6 kubenswrapper[2580]: W0710 21:00:00.554957 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc5362a0_0b53_4eb7_9e0a_a8a78780228e.slice/crio-52617a96ee771239aebe6bfd3f770d0b8f9b0f2baeddcc09d7f4ab504a00735b WatchSource:0}: Error finding container 52617a96ee771239aebe6bfd3f770d0b8f9b0f2baeddcc09d7f4ab504a00735b: Status 404 returned error can't find the container with id 52617a96ee771239aebe6bfd3f770d0b8f9b0f2baeddcc09d7f4ab504a00735b Jul 10 21:00:01.508224 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:01.508191 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e560d0-29728620-kl2pp" event={"ID":"bc5362a0-0b53-4eb7-9e0a-a8a78780228e","Type":"ContainerStarted","Data":"52617a96ee771239aebe6bfd3f770d0b8f9b0f2baeddcc09d7f4ab504a00735b"} Jul 10 21:00:17.601544 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:17.601504 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-28db1d-29728620-7ctpf" event={"ID":"34dffd42-71a8-41fb-9597-5cb26c60e807","Type":"ContainerStarted","Data":"1b235cc6799e68022bad494afc1242731907852717439bfbcf31ff6c16fe7506"} Jul 10 21:00:17.603046 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:17.603015 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e560d0-29728620-kl2pp" event={"ID":"bc5362a0-0b53-4eb7-9e0a-a8a78780228e","Type":"ContainerStarted","Data":"b7f7081fa442e95bb8e1b39cfda3e16cef42b18f35db1fb9bab89f74d7183f7e"} Jul 10 21:00:17.604321 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:17.604301 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728620-ng7mk" event={"ID":"8cc0360c-ef09-48ad-9aa9-8d6a6f6f5b4f","Type":"ContainerStarted","Data":"ecace6fbc81f96ce18df8c72e58ad8a028bc78aabd67abda288ad3699288c0b7"} Jul 10 21:00:17.618073 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:17.618022 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-28db1d-29728620-7ctpf" podStartSLOduration=1.245067011 podStartE2EDuration="17.618008635s" totalImagesPullingTime="16.372941624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:00:17.615654141 +0000 UTC m=+2339.075858968" watchObservedRunningTime="2026-07-10 21:00:17.618008635 +0000 UTC m=+2339.078213461" Jul 10 21:00:17.631501 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:17.631457 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e560d0-29728620-kl2pp" podStartSLOduration=1.488258169 podStartE2EDuration="17.631443371s" totalImagesPullingTime="16.143185202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:00:17.629516147 +0000 UTC m=+2339.089720974" watchObservedRunningTime="2026-07-10 21:00:17.631443371 +0000 UTC m=+2339.091648196" Jul 10 21:00:17.644657 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:00:17.644615 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728620-ng7mk" podStartSLOduration=1.318800937 podStartE2EDuration="17.644602849s" totalImagesPullingTime="16.325801912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:00:17.643533757 +0000 UTC m=+2339.103738583" watchObservedRunningTime="2026-07-10 21:00:17.644602849 +0000 UTC m=+2339.104807671" Jul 10 21:01:00.010754 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:00.010719 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728620-ng7mk"] Jul 10 21:01:00.011267 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:00.010906 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728620-ng7mk" podUID="8cc0360c-ef09-48ad-9aa9-8d6a6f6f5b4f" containerName="cleanup" containerID="cri-o://ecace6fbc81f96ce18df8c72e58ad8a028bc78aabd67abda288ad3699288c0b7" gracePeriod=30 Jul 10 21:01:00.014082 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:00.014060 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e560d0-29728620-kl2pp"] Jul 10 21:01:00.014290 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:00.014258 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e560d0-29728620-kl2pp" podUID="bc5362a0-0b53-4eb7-9e0a-a8a78780228e" containerName="cleanup" containerID="cri-o://b7f7081fa442e95bb8e1b39cfda3e16cef42b18f35db1fb9bab89f74d7183f7e" gracePeriod=30 Jul 10 21:01:00.016145 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:00.016111 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-28db1d-29728620-7ctpf"] Jul 10 21:01:00.016321 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:00.016286 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-28db1d-29728620-7ctpf" podUID="34dffd42-71a8-41fb-9597-5cb26c60e807" containerName="cleanup" containerID="cri-o://1b235cc6799e68022bad494afc1242731907852717439bfbcf31ff6c16fe7506" gracePeriod=30 Jul 10 21:01:19.809690 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:19.809657 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 21:01:19.816295 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:19.816269 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-n9x79_54408f7e-c518-4ea9-943f-f77237ea1102/ovn-acl-logging/0.log" Jul 10 21:01:30.214204 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:30.214175 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728620-ng7mk" Jul 10 21:01:30.274968 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:30.274913 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e560d0-29728620-kl2pp" Jul 10 21:01:30.278282 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:30.278256 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-28db1d-29728620-7ctpf" Jul 10 21:01:31.014313 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.014276 2580 generic.go:356] "Generic (PLEG): container finished" podID="bc5362a0-0b53-4eb7-9e0a-a8a78780228e" containerID="b7f7081fa442e95bb8e1b39cfda3e16cef42b18f35db1fb9bab89f74d7183f7e" exitCode=137 Jul 10 21:01:31.014518 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.014319 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e560d0-29728620-kl2pp" Jul 10 21:01:31.014518 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.014358 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e560d0-29728620-kl2pp" event={"ID":"bc5362a0-0b53-4eb7-9e0a-a8a78780228e","Type":"ContainerDied","Data":"b7f7081fa442e95bb8e1b39cfda3e16cef42b18f35db1fb9bab89f74d7183f7e"} Jul 10 21:01:31.014518 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.014411 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e560d0-29728620-kl2pp" event={"ID":"bc5362a0-0b53-4eb7-9e0a-a8a78780228e","Type":"ContainerDied","Data":"52617a96ee771239aebe6bfd3f770d0b8f9b0f2baeddcc09d7f4ab504a00735b"} Jul 10 21:01:31.014518 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.014440 2580 scope.go:117] "RemoveContainer" containerID="b7f7081fa442e95bb8e1b39cfda3e16cef42b18f35db1fb9bab89f74d7183f7e" Jul 10 21:01:31.015761 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.015733 2580 generic.go:356] "Generic (PLEG): container finished" podID="8cc0360c-ef09-48ad-9aa9-8d6a6f6f5b4f" containerID="ecace6fbc81f96ce18df8c72e58ad8a028bc78aabd67abda288ad3699288c0b7" exitCode=137 Jul 10 21:01:31.015883 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.015766 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728620-ng7mk" Jul 10 21:01:31.015883 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.015862 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728620-ng7mk" event={"ID":"8cc0360c-ef09-48ad-9aa9-8d6a6f6f5b4f","Type":"ContainerDied","Data":"ecace6fbc81f96ce18df8c72e58ad8a028bc78aabd67abda288ad3699288c0b7"} Jul 10 21:01:31.016007 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.015906 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29728620-ng7mk" event={"ID":"8cc0360c-ef09-48ad-9aa9-8d6a6f6f5b4f","Type":"ContainerDied","Data":"5a5d2ed0e2ad5e57d996ed142a3f0ef85761dd0d744686225bf2c6989ddf50ae"} Jul 10 21:01:31.017281 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.017253 2580 generic.go:356] "Generic (PLEG): container finished" podID="34dffd42-71a8-41fb-9597-5cb26c60e807" containerID="1b235cc6799e68022bad494afc1242731907852717439bfbcf31ff6c16fe7506" exitCode=137 Jul 10 21:01:31.017401 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.017294 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-28db1d-29728620-7ctpf" event={"ID":"34dffd42-71a8-41fb-9597-5cb26c60e807","Type":"ContainerDied","Data":"1b235cc6799e68022bad494afc1242731907852717439bfbcf31ff6c16fe7506"} Jul 10 21:01:31.017401 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.017305 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-28db1d-29728620-7ctpf" Jul 10 21:01:31.017401 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.017332 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-28db1d-29728620-7ctpf" event={"ID":"34dffd42-71a8-41fb-9597-5cb26c60e807","Type":"ContainerDied","Data":"bda0753e5d0a7832b46d031e6f06a2d98af23e17eb51a9106d35b0bf008c8e02"} Jul 10 21:01:31.028290 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.026195 2580 scope.go:117] "RemoveContainer" containerID="b7f7081fa442e95bb8e1b39cfda3e16cef42b18f35db1fb9bab89f74d7183f7e" Jul 10 21:01:31.028679 ip-10-0-133-6 kubenswrapper[2580]: E0710 21:01:31.028643 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7f7081fa442e95bb8e1b39cfda3e16cef42b18f35db1fb9bab89f74d7183f7e\": container with ID starting with b7f7081fa442e95bb8e1b39cfda3e16cef42b18f35db1fb9bab89f74d7183f7e not found: ID does not exist" containerID="b7f7081fa442e95bb8e1b39cfda3e16cef42b18f35db1fb9bab89f74d7183f7e" Jul 10 21:01:31.028798 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.028740 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7f7081fa442e95bb8e1b39cfda3e16cef42b18f35db1fb9bab89f74d7183f7e"} err="failed to get container status \"b7f7081fa442e95bb8e1b39cfda3e16cef42b18f35db1fb9bab89f74d7183f7e\": rpc error: code = NotFound desc = could not find container \"b7f7081fa442e95bb8e1b39cfda3e16cef42b18f35db1fb9bab89f74d7183f7e\": container with ID starting with b7f7081fa442e95bb8e1b39cfda3e16cef42b18f35db1fb9bab89f74d7183f7e not found: ID does not exist" Jul 10 21:01:31.028875 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.028805 2580 scope.go:117] "RemoveContainer" containerID="ecace6fbc81f96ce18df8c72e58ad8a028bc78aabd67abda288ad3699288c0b7" Jul 10 21:01:31.038204 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.038186 2580 scope.go:117] "RemoveContainer" containerID="ecace6fbc81f96ce18df8c72e58ad8a028bc78aabd67abda288ad3699288c0b7" Jul 10 21:01:31.038605 ip-10-0-133-6 kubenswrapper[2580]: E0710 21:01:31.038582 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecace6fbc81f96ce18df8c72e58ad8a028bc78aabd67abda288ad3699288c0b7\": container with ID starting with ecace6fbc81f96ce18df8c72e58ad8a028bc78aabd67abda288ad3699288c0b7 not found: ID does not exist" containerID="ecace6fbc81f96ce18df8c72e58ad8a028bc78aabd67abda288ad3699288c0b7" Jul 10 21:01:31.038678 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.038615 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecace6fbc81f96ce18df8c72e58ad8a028bc78aabd67abda288ad3699288c0b7"} err="failed to get container status \"ecace6fbc81f96ce18df8c72e58ad8a028bc78aabd67abda288ad3699288c0b7\": rpc error: code = NotFound desc = could not find container \"ecace6fbc81f96ce18df8c72e58ad8a028bc78aabd67abda288ad3699288c0b7\": container with ID starting with ecace6fbc81f96ce18df8c72e58ad8a028bc78aabd67abda288ad3699288c0b7 not found: ID does not exist" Jul 10 21:01:31.038678 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.038635 2580 scope.go:117] "RemoveContainer" containerID="1b235cc6799e68022bad494afc1242731907852717439bfbcf31ff6c16fe7506" Jul 10 21:01:31.044708 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.044686 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e560d0-29728620-kl2pp"] Jul 10 21:01:31.047105 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.047088 2580 scope.go:117] "RemoveContainer" containerID="1b235cc6799e68022bad494afc1242731907852717439bfbcf31ff6c16fe7506" Jul 10 21:01:31.047388 ip-10-0-133-6 kubenswrapper[2580]: E0710 21:01:31.047360 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b235cc6799e68022bad494afc1242731907852717439bfbcf31ff6c16fe7506\": container with ID starting with 1b235cc6799e68022bad494afc1242731907852717439bfbcf31ff6c16fe7506 not found: ID does not exist" containerID="1b235cc6799e68022bad494afc1242731907852717439bfbcf31ff6c16fe7506" Jul 10 21:01:31.047449 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.047387 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b235cc6799e68022bad494afc1242731907852717439bfbcf31ff6c16fe7506"} err="failed to get container status \"1b235cc6799e68022bad494afc1242731907852717439bfbcf31ff6c16fe7506\": rpc error: code = NotFound desc = could not find container \"1b235cc6799e68022bad494afc1242731907852717439bfbcf31ff6c16fe7506\": container with ID starting with 1b235cc6799e68022bad494afc1242731907852717439bfbcf31ff6c16fe7506 not found: ID does not exist" Jul 10 21:01:31.048050 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.048032 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-e560d0-29728620-kl2pp"] Jul 10 21:01:31.057530 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.057508 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728620-ng7mk"] Jul 10 21:01:31.061400 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.061378 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29728620-ng7mk"] Jul 10 21:01:31.071341 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.071312 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-28db1d-29728620-7ctpf"] Jul 10 21:01:31.077289 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.077267 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-28db1d-29728620-7ctpf"] Jul 10 21:01:31.660247 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.660218 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34dffd42-71a8-41fb-9597-5cb26c60e807" path="/var/lib/kubelet/pods/34dffd42-71a8-41fb-9597-5cb26c60e807/volumes" Jul 10 21:01:31.660624 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.660489 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cc0360c-ef09-48ad-9aa9-8d6a6f6f5b4f" path="/var/lib/kubelet/pods/8cc0360c-ef09-48ad-9aa9-8d6a6f6f5b4f/volumes" Jul 10 21:01:31.660692 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:01:31.660678 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc5362a0-0b53-4eb7-9e0a-a8a78780228e" path="/var/lib/kubelet/pods/bc5362a0-0b53-4eb7-9e0a-a8a78780228e/volumes" Jul 10 21:03:29.729146 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:29.729043 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7074-140567206042544"] Jul 10 21:03:29.729637 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:29.729428 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc5362a0-0b53-4eb7-9e0a-a8a78780228e" containerName="cleanup" Jul 10 21:03:29.729637 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:29.729440 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc5362a0-0b53-4eb7-9e0a-a8a78780228e" containerName="cleanup" Jul 10 21:03:29.729637 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:29.729451 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cc0360c-ef09-48ad-9aa9-8d6a6f6f5b4f" containerName="cleanup" Jul 10 21:03:29.729637 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:29.729457 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cc0360c-ef09-48ad-9aa9-8d6a6f6f5b4f" containerName="cleanup" Jul 10 21:03:29.729637 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:29.729479 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34dffd42-71a8-41fb-9597-5cb26c60e807" containerName="cleanup" Jul 10 21:03:29.729637 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:29.729486 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="34dffd42-71a8-41fb-9597-5cb26c60e807" containerName="cleanup" Jul 10 21:03:29.729637 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:29.729538 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="34dffd42-71a8-41fb-9597-5cb26c60e807" containerName="cleanup" Jul 10 21:03:29.729637 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:29.729546 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cc0360c-ef09-48ad-9aa9-8d6a6f6f5b4f" containerName="cleanup" Jul 10 21:03:29.729637 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:29.729553 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc5362a0-0b53-4eb7-9e0a-a8a78780228e" containerName="cleanup" Jul 10 21:03:29.731456 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:29.731440 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567206042544" Jul 10 21:03:29.733657 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:29.733634 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-49z4d\"" Jul 10 21:03:29.737649 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:29.737628 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7074-140567206042544"] Jul 10 21:03:29.862166 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:29.862109 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcnbv\" (UniqueName: \"kubernetes.io/projected/c2de25bb-02e0-4b6e-a05d-d47b439189a8-kube-api-access-mcnbv\") pod \"test-curl-7074-140567206042544\" (UID: \"c2de25bb-02e0-4b6e-a05d-d47b439189a8\") " pod="openshift-ingress/test-curl-7074-140567206042544" Jul 10 21:03:29.962914 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:29.962869 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcnbv\" (UniqueName: \"kubernetes.io/projected/c2de25bb-02e0-4b6e-a05d-d47b439189a8-kube-api-access-mcnbv\") pod \"test-curl-7074-140567206042544\" (UID: \"c2de25bb-02e0-4b6e-a05d-d47b439189a8\") " pod="openshift-ingress/test-curl-7074-140567206042544" Jul 10 21:03:29.970620 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:29.970584 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcnbv\" (UniqueName: \"kubernetes.io/projected/c2de25bb-02e0-4b6e-a05d-d47b439189a8-kube-api-access-mcnbv\") pod \"test-curl-7074-140567206042544\" (UID: \"c2de25bb-02e0-4b6e-a05d-d47b439189a8\") " pod="openshift-ingress/test-curl-7074-140567206042544" Jul 10 21:03:30.041504 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:30.041420 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567206042544" Jul 10 21:03:30.175243 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:30.175215 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7074-140567206042544"] Jul 10 21:03:30.177970 ip-10-0-133-6 kubenswrapper[2580]: W0710 21:03:30.177937 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2de25bb_02e0_4b6e_a05d_d47b439189a8.slice/crio-32dd51d7ab5a8f969bba7502736644cf9e883aa73d77f90f522d361facdb2941 WatchSource:0}: Error finding container 32dd51d7ab5a8f969bba7502736644cf9e883aa73d77f90f522d361facdb2941: Status 404 returned error can't find the container with id 32dd51d7ab5a8f969bba7502736644cf9e883aa73d77f90f522d361facdb2941 Jul 10 21:03:30.676544 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:30.676512 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7074-140567206042544" event={"ID":"c2de25bb-02e0-4b6e-a05d-d47b439189a8","Type":"ContainerStarted","Data":"32dd51d7ab5a8f969bba7502736644cf9e883aa73d77f90f522d361facdb2941"} Jul 10 21:03:31.683159 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:31.683108 2580 generic.go:356] "Generic (PLEG): container finished" podID="c2de25bb-02e0-4b6e-a05d-d47b439189a8" containerID="971f2fa66530dacb26e978e2f75cfc0a2c7632f3d7e8b662953812a10a9df497" exitCode=0 Jul 10 21:03:31.683159 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:31.683166 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7074-140567206042544" event={"ID":"c2de25bb-02e0-4b6e-a05d-d47b439189a8","Type":"ContainerDied","Data":"971f2fa66530dacb26e978e2f75cfc0a2c7632f3d7e8b662953812a10a9df497"} Jul 10 21:03:32.830571 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:32.830546 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567206042544" Jul 10 21:03:32.866088 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:32.866050 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7074-140567206042544_c2de25bb-02e0-4b6e-a05d-d47b439189a8/test-curl-7074-140567206042544/0.log" Jul 10 21:03:32.891938 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:32.891898 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7074-140567206042544"] Jul 10 21:03:32.894318 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:32.894291 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7074-140567206042544"] Jul 10 21:03:32.987876 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:32.987794 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcnbv\" (UniqueName: \"kubernetes.io/projected/c2de25bb-02e0-4b6e-a05d-d47b439189a8-kube-api-access-mcnbv\") pod \"c2de25bb-02e0-4b6e-a05d-d47b439189a8\" (UID: \"c2de25bb-02e0-4b6e-a05d-d47b439189a8\") " Jul 10 21:03:32.989929 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:32.989890 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2de25bb-02e0-4b6e-a05d-d47b439189a8-kube-api-access-mcnbv" (OuterVolumeSpecName: "kube-api-access-mcnbv") pod "c2de25bb-02e0-4b6e-a05d-d47b439189a8" (UID: "c2de25bb-02e0-4b6e-a05d-d47b439189a8"). InnerVolumeSpecName "kube-api-access-mcnbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:03:33.007738 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:33.007713 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7074-140567206043184"] Jul 10 21:03:33.008078 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:33.008066 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2de25bb-02e0-4b6e-a05d-d47b439189a8" containerName="test-curl-7074-140567206042544" Jul 10 21:03:33.008121 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:33.008079 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2de25bb-02e0-4b6e-a05d-d47b439189a8" containerName="test-curl-7074-140567206042544" Jul 10 21:03:33.008183 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:33.008166 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2de25bb-02e0-4b6e-a05d-d47b439189a8" containerName="test-curl-7074-140567206042544" Jul 10 21:03:33.010317 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:33.010301 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567206043184" Jul 10 21:03:33.014846 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:33.014819 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7074-140567206043184"] Jul 10 21:03:33.089268 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:33.089230 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcnbv\" (UniqueName: \"kubernetes.io/projected/c2de25bb-02e0-4b6e-a05d-d47b439189a8-kube-api-access-mcnbv\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 21:03:33.190496 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:33.190452 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kcst\" (UniqueName: \"kubernetes.io/projected/7ea2c238-8eb6-479b-bdcc-1ecaea2845af-kube-api-access-2kcst\") pod \"test-curl-7074-140567206043184\" (UID: \"7ea2c238-8eb6-479b-bdcc-1ecaea2845af\") " pod="openshift-ingress/test-curl-7074-140567206043184" Jul 10 21:03:33.291868 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:33.291776 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kcst\" (UniqueName: \"kubernetes.io/projected/7ea2c238-8eb6-479b-bdcc-1ecaea2845af-kube-api-access-2kcst\") pod \"test-curl-7074-140567206043184\" (UID: \"7ea2c238-8eb6-479b-bdcc-1ecaea2845af\") " pod="openshift-ingress/test-curl-7074-140567206043184" Jul 10 21:03:33.299440 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:33.299407 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kcst\" (UniqueName: \"kubernetes.io/projected/7ea2c238-8eb6-479b-bdcc-1ecaea2845af-kube-api-access-2kcst\") pod \"test-curl-7074-140567206043184\" (UID: \"7ea2c238-8eb6-479b-bdcc-1ecaea2845af\") " pod="openshift-ingress/test-curl-7074-140567206043184" Jul 10 21:03:33.320351 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:33.320318 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567206043184" Jul 10 21:03:33.449424 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:33.449402 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7074-140567206043184"] Jul 10 21:03:33.451313 ip-10-0-133-6 kubenswrapper[2580]: W0710 21:03:33.451289 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ea2c238_8eb6_479b_bdcc_1ecaea2845af.slice/crio-ab99c2cb11f8f557d56cebc549c8c21725d23e076d23de028ab5d2eea7ad363d WatchSource:0}: Error finding container ab99c2cb11f8f557d56cebc549c8c21725d23e076d23de028ab5d2eea7ad363d: Status 404 returned error can't find the container with id ab99c2cb11f8f557d56cebc549c8c21725d23e076d23de028ab5d2eea7ad363d Jul 10 21:03:33.661280 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:33.661245 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2de25bb-02e0-4b6e-a05d-d47b439189a8" path="/var/lib/kubelet/pods/c2de25bb-02e0-4b6e-a05d-d47b439189a8/volumes" Jul 10 21:03:33.695541 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:33.695504 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7074-140567206043184" event={"ID":"7ea2c238-8eb6-479b-bdcc-1ecaea2845af","Type":"ContainerStarted","Data":"ab99c2cb11f8f557d56cebc549c8c21725d23e076d23de028ab5d2eea7ad363d"} Jul 10 21:03:33.696677 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:33.696659 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567206042544" Jul 10 21:03:33.696842 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:33.696689 2580 scope.go:117] "RemoveContainer" containerID="971f2fa66530dacb26e978e2f75cfc0a2c7632f3d7e8b662953812a10a9df497" Jul 10 21:03:34.703549 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:34.703506 2580 generic.go:356] "Generic (PLEG): container finished" podID="7ea2c238-8eb6-479b-bdcc-1ecaea2845af" containerID="f853d642301a52704902f1a4ecd2a34f2e213d8fea26457434938e7d58f4865a" exitCode=0 Jul 10 21:03:34.703549 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:34.703545 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7074-140567206043184" event={"ID":"7ea2c238-8eb6-479b-bdcc-1ecaea2845af","Type":"ContainerDied","Data":"f853d642301a52704902f1a4ecd2a34f2e213d8fea26457434938e7d58f4865a"} Jul 10 21:03:35.848870 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:35.848846 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567206043184" Jul 10 21:03:35.871717 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:35.871687 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7074-140567206043184_7ea2c238-8eb6-479b-bdcc-1ecaea2845af/test-curl-7074-140567206043184/0.log" Jul 10 21:03:35.897247 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:35.897218 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7074-140567206043184"] Jul 10 21:03:35.902949 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:35.902921 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7074-140567206043184"] Jul 10 21:03:35.915814 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:35.915787 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kcst\" (UniqueName: \"kubernetes.io/projected/7ea2c238-8eb6-479b-bdcc-1ecaea2845af-kube-api-access-2kcst\") pod \"7ea2c238-8eb6-479b-bdcc-1ecaea2845af\" (UID: \"7ea2c238-8eb6-479b-bdcc-1ecaea2845af\") " Jul 10 21:03:35.918121 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:35.918099 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ea2c238-8eb6-479b-bdcc-1ecaea2845af-kube-api-access-2kcst" (OuterVolumeSpecName: "kube-api-access-2kcst") pod "7ea2c238-8eb6-479b-bdcc-1ecaea2845af" (UID: "7ea2c238-8eb6-479b-bdcc-1ecaea2845af"). InnerVolumeSpecName "kube-api-access-2kcst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:03:36.017221 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:36.017112 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kcst\" (UniqueName: \"kubernetes.io/projected/7ea2c238-8eb6-479b-bdcc-1ecaea2845af-kube-api-access-2kcst\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 21:03:36.050025 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:36.049994 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7074-140567204546432"] Jul 10 21:03:36.050368 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:36.050356 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ea2c238-8eb6-479b-bdcc-1ecaea2845af" containerName="test-curl-7074-140567206043184" Jul 10 21:03:36.050425 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:36.050370 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ea2c238-8eb6-479b-bdcc-1ecaea2845af" containerName="test-curl-7074-140567206043184" Jul 10 21:03:36.050461 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:36.050445 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ea2c238-8eb6-479b-bdcc-1ecaea2845af" containerName="test-curl-7074-140567206043184" Jul 10 21:03:36.052592 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:36.052576 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567204546432" Jul 10 21:03:36.059198 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:36.059170 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7074-140567204546432"] Jul 10 21:03:36.118037 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:36.118002 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrjs9\" (UniqueName: \"kubernetes.io/projected/b7699eef-a9fe-41bb-9fa6-486073a989e1-kube-api-access-mrjs9\") pod \"test-curl-7074-140567204546432\" (UID: \"b7699eef-a9fe-41bb-9fa6-486073a989e1\") " pod="openshift-ingress/test-curl-7074-140567204546432" Jul 10 21:03:36.219370 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:36.219330 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrjs9\" (UniqueName: \"kubernetes.io/projected/b7699eef-a9fe-41bb-9fa6-486073a989e1-kube-api-access-mrjs9\") pod \"test-curl-7074-140567204546432\" (UID: \"b7699eef-a9fe-41bb-9fa6-486073a989e1\") " pod="openshift-ingress/test-curl-7074-140567204546432" Jul 10 21:03:36.227552 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:36.227529 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrjs9\" (UniqueName: \"kubernetes.io/projected/b7699eef-a9fe-41bb-9fa6-486073a989e1-kube-api-access-mrjs9\") pod \"test-curl-7074-140567204546432\" (UID: \"b7699eef-a9fe-41bb-9fa6-486073a989e1\") " pod="openshift-ingress/test-curl-7074-140567204546432" Jul 10 21:03:36.363340 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:36.363238 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567204546432" Jul 10 21:03:36.492557 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:36.492531 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7074-140567204546432"] Jul 10 21:03:36.494430 ip-10-0-133-6 kubenswrapper[2580]: W0710 21:03:36.494405 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7699eef_a9fe_41bb_9fa6_486073a989e1.slice/crio-ab468d74178333a6e0c63bf3bd1c636de4613cc25b953ef5317c35c5bb594759 WatchSource:0}: Error finding container ab468d74178333a6e0c63bf3bd1c636de4613cc25b953ef5317c35c5bb594759: Status 404 returned error can't find the container with id ab468d74178333a6e0c63bf3bd1c636de4613cc25b953ef5317c35c5bb594759 Jul 10 21:03:36.716081 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:36.716047 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7074-140567204546432" event={"ID":"b7699eef-a9fe-41bb-9fa6-486073a989e1","Type":"ContainerStarted","Data":"ab468d74178333a6e0c63bf3bd1c636de4613cc25b953ef5317c35c5bb594759"} Jul 10 21:03:36.717284 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:36.717266 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567206043184" Jul 10 21:03:36.717390 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:36.717298 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab99c2cb11f8f557d56cebc549c8c21725d23e076d23de028ab5d2eea7ad363d" Jul 10 21:03:36.728007 ip-10-0-133-6 kubenswrapper[2580]: E0710 21:03:36.727983 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7074-140567206043184\" is forbidden: User \"system:node:ip-10-0-133-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-6.ec2.internal' and this object" podUID="7ea2c238-8eb6-479b-bdcc-1ecaea2845af" pod="openshift-ingress/test-curl-7074-140567206043184" Jul 10 21:03:37.662509 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:37.662474 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ea2c238-8eb6-479b-bdcc-1ecaea2845af" path="/var/lib/kubelet/pods/7ea2c238-8eb6-479b-bdcc-1ecaea2845af/volumes" Jul 10 21:03:37.724427 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:37.724392 2580 generic.go:356] "Generic (PLEG): container finished" podID="b7699eef-a9fe-41bb-9fa6-486073a989e1" containerID="19e26610886bcb751b237eabe8a439007db96a4199406c4e4f4f05c60958fdc8" exitCode=0 Jul 10 21:03:37.724600 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:37.724480 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7074-140567204546432" event={"ID":"b7699eef-a9fe-41bb-9fa6-486073a989e1","Type":"ContainerDied","Data":"19e26610886bcb751b237eabe8a439007db96a4199406c4e4f4f05c60958fdc8"} Jul 10 21:03:38.873885 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:38.873853 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567204546432" Jul 10 21:03:38.894300 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:38.894272 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7074-140567204546432_b7699eef-a9fe-41bb-9fa6-486073a989e1/test-curl-7074-140567204546432/0.log" Jul 10 21:03:38.919878 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:38.919847 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7074-140567204546432"] Jul 10 21:03:38.923641 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:38.923614 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7074-140567204546432"] Jul 10 21:03:38.943987 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:38.943961 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrjs9\" (UniqueName: \"kubernetes.io/projected/b7699eef-a9fe-41bb-9fa6-486073a989e1-kube-api-access-mrjs9\") pod \"b7699eef-a9fe-41bb-9fa6-486073a989e1\" (UID: \"b7699eef-a9fe-41bb-9fa6-486073a989e1\") " Jul 10 21:03:38.945969 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:38.945940 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7699eef-a9fe-41bb-9fa6-486073a989e1-kube-api-access-mrjs9" (OuterVolumeSpecName: "kube-api-access-mrjs9") pod "b7699eef-a9fe-41bb-9fa6-486073a989e1" (UID: "b7699eef-a9fe-41bb-9fa6-486073a989e1"). InnerVolumeSpecName "kube-api-access-mrjs9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:03:39.033892 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:39.033811 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7074-140567204546432"] Jul 10 21:03:39.034199 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:39.034186 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7699eef-a9fe-41bb-9fa6-486073a989e1" containerName="test-curl-7074-140567204546432" Jul 10 21:03:39.034247 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:39.034201 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7699eef-a9fe-41bb-9fa6-486073a989e1" containerName="test-curl-7074-140567204546432" Jul 10 21:03:39.034283 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:39.034278 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7699eef-a9fe-41bb-9fa6-486073a989e1" containerName="test-curl-7074-140567204546432" Jul 10 21:03:39.036166 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:39.036149 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567204546432" Jul 10 21:03:39.044037 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:39.044003 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7074-140567204546432"] Jul 10 21:03:39.044793 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:39.044772 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6j6x\" (UniqueName: \"kubernetes.io/projected/d2eed00f-e526-4853-85cb-cb2a07be5793-kube-api-access-f6j6x\") pod \"test-curl-7074-140567204546432\" (UID: \"d2eed00f-e526-4853-85cb-cb2a07be5793\") " pod="openshift-ingress/test-curl-7074-140567204546432" Jul 10 21:03:39.044886 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:39.044824 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrjs9\" (UniqueName: \"kubernetes.io/projected/b7699eef-a9fe-41bb-9fa6-486073a989e1-kube-api-access-mrjs9\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 21:03:39.145295 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:39.145259 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6j6x\" (UniqueName: \"kubernetes.io/projected/d2eed00f-e526-4853-85cb-cb2a07be5793-kube-api-access-f6j6x\") pod \"test-curl-7074-140567204546432\" (UID: \"d2eed00f-e526-4853-85cb-cb2a07be5793\") " pod="openshift-ingress/test-curl-7074-140567204546432" Jul 10 21:03:39.153195 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:39.153168 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6j6x\" (UniqueName: \"kubernetes.io/projected/d2eed00f-e526-4853-85cb-cb2a07be5793-kube-api-access-f6j6x\") pod \"test-curl-7074-140567204546432\" (UID: \"d2eed00f-e526-4853-85cb-cb2a07be5793\") " pod="openshift-ingress/test-curl-7074-140567204546432" Jul 10 21:03:39.345274 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:39.345178 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567204546432" Jul 10 21:03:39.478270 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:39.478243 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7074-140567204546432"] Jul 10 21:03:39.480733 ip-10-0-133-6 kubenswrapper[2580]: W0710 21:03:39.480711 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2eed00f_e526_4853_85cb_cb2a07be5793.slice/crio-a02f24dffdcab12a4cca6a7be3709755cc41a22332fa2bdcc18b2379a8f3cf6d WatchSource:0}: Error finding container a02f24dffdcab12a4cca6a7be3709755cc41a22332fa2bdcc18b2379a8f3cf6d: Status 404 returned error can't find the container with id a02f24dffdcab12a4cca6a7be3709755cc41a22332fa2bdcc18b2379a8f3cf6d Jul 10 21:03:39.661075 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:39.661043 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7699eef-a9fe-41bb-9fa6-486073a989e1" path="/var/lib/kubelet/pods/b7699eef-a9fe-41bb-9fa6-486073a989e1/volumes" Jul 10 21:03:39.735917 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:39.735885 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567204546432" Jul 10 21:03:39.735917 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:39.735885 2580 scope.go:117] "RemoveContainer" containerID="19e26610886bcb751b237eabe8a439007db96a4199406c4e4f4f05c60958fdc8" Jul 10 21:03:39.737178 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:39.737124 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7074-140567204546432" event={"ID":"d2eed00f-e526-4853-85cb-cb2a07be5793","Type":"ContainerStarted","Data":"a02f24dffdcab12a4cca6a7be3709755cc41a22332fa2bdcc18b2379a8f3cf6d"} Jul 10 21:03:40.745003 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:40.744967 2580 generic.go:356] "Generic (PLEG): container finished" podID="d2eed00f-e526-4853-85cb-cb2a07be5793" containerID="12963afb9d6c1b60a3dac1f471bbf46c35854c0cfb237057a798400a7ce9c2a5" exitCode=0 Jul 10 21:03:40.745405 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:40.745053 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7074-140567204546432" event={"ID":"d2eed00f-e526-4853-85cb-cb2a07be5793","Type":"ContainerDied","Data":"12963afb9d6c1b60a3dac1f471bbf46c35854c0cfb237057a798400a7ce9c2a5"} Jul 10 21:03:41.893985 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:41.893957 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567204546432" Jul 10 21:03:41.915502 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:41.915471 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7074-140567204546432_d2eed00f-e526-4853-85cb-cb2a07be5793/test-curl-7074-140567204546432/0.log" Jul 10 21:03:41.942300 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:41.942272 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7074-140567204546432"] Jul 10 21:03:41.945699 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:41.945674 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7074-140567204546432"] Jul 10 21:03:41.973112 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:41.973084 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6j6x\" (UniqueName: \"kubernetes.io/projected/d2eed00f-e526-4853-85cb-cb2a07be5793-kube-api-access-f6j6x\") pod \"d2eed00f-e526-4853-85cb-cb2a07be5793\" (UID: \"d2eed00f-e526-4853-85cb-cb2a07be5793\") " Jul 10 21:03:41.975088 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:41.975061 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2eed00f-e526-4853-85cb-cb2a07be5793-kube-api-access-f6j6x" (OuterVolumeSpecName: "kube-api-access-f6j6x") pod "d2eed00f-e526-4853-85cb-cb2a07be5793" (UID: "d2eed00f-e526-4853-85cb-cb2a07be5793"). InnerVolumeSpecName "kube-api-access-f6j6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:03:42.060186 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:42.060087 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7074-140567204547440"] Jul 10 21:03:42.060511 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:42.060497 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2eed00f-e526-4853-85cb-cb2a07be5793" containerName="test-curl-7074-140567204546432" Jul 10 21:03:42.060555 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:42.060513 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2eed00f-e526-4853-85cb-cb2a07be5793" containerName="test-curl-7074-140567204546432" Jul 10 21:03:42.060593 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:42.060584 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2eed00f-e526-4853-85cb-cb2a07be5793" containerName="test-curl-7074-140567204546432" Jul 10 21:03:42.062633 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:42.062617 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567204547440" Jul 10 21:03:42.070514 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:42.070493 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7074-140567204547440"] Jul 10 21:03:42.074406 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:42.074388 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6j6x\" (UniqueName: \"kubernetes.io/projected/d2eed00f-e526-4853-85cb-cb2a07be5793-kube-api-access-f6j6x\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 21:03:42.175739 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:42.175705 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4qzg\" (UniqueName: \"kubernetes.io/projected/bbbc6c44-b146-430a-b6f5-71a22836472f-kube-api-access-d4qzg\") pod \"test-curl-7074-140567204547440\" (UID: \"bbbc6c44-b146-430a-b6f5-71a22836472f\") " pod="openshift-ingress/test-curl-7074-140567204547440" Jul 10 21:03:42.276606 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:42.276568 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4qzg\" (UniqueName: \"kubernetes.io/projected/bbbc6c44-b146-430a-b6f5-71a22836472f-kube-api-access-d4qzg\") pod \"test-curl-7074-140567204547440\" (UID: \"bbbc6c44-b146-430a-b6f5-71a22836472f\") " pod="openshift-ingress/test-curl-7074-140567204547440" Jul 10 21:03:42.284913 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:42.284888 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4qzg\" (UniqueName: \"kubernetes.io/projected/bbbc6c44-b146-430a-b6f5-71a22836472f-kube-api-access-d4qzg\") pod \"test-curl-7074-140567204547440\" (UID: \"bbbc6c44-b146-430a-b6f5-71a22836472f\") " pod="openshift-ingress/test-curl-7074-140567204547440" Jul 10 21:03:42.372604 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:42.372510 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567204547440" Jul 10 21:03:42.504677 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:42.504654 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7074-140567204547440"] Jul 10 21:03:42.505783 ip-10-0-133-6 kubenswrapper[2580]: W0710 21:03:42.505759 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbbc6c44_b146_430a_b6f5_71a22836472f.slice/crio-164e3e23aaf3136425d56386f88477cf46dbaa338f4a738ba6dafafe2409ef1f WatchSource:0}: Error finding container 164e3e23aaf3136425d56386f88477cf46dbaa338f4a738ba6dafafe2409ef1f: Status 404 returned error can't find the container with id 164e3e23aaf3136425d56386f88477cf46dbaa338f4a738ba6dafafe2409ef1f Jul 10 21:03:42.757151 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:42.757096 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567204546432" Jul 10 21:03:42.757151 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:42.757148 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a02f24dffdcab12a4cca6a7be3709755cc41a22332fa2bdcc18b2379a8f3cf6d" Jul 10 21:03:42.758419 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:42.758390 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7074-140567204547440" event={"ID":"bbbc6c44-b146-430a-b6f5-71a22836472f","Type":"ContainerStarted","Data":"164e3e23aaf3136425d56386f88477cf46dbaa338f4a738ba6dafafe2409ef1f"} Jul 10 21:03:42.767534 ip-10-0-133-6 kubenswrapper[2580]: E0710 21:03:42.767511 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7074-140567204546432\" is forbidden: User \"system:node:ip-10-0-133-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-6.ec2.internal' and this object" podUID="d2eed00f-e526-4853-85cb-cb2a07be5793" pod="openshift-ingress/test-curl-7074-140567204546432" Jul 10 21:03:43.661177 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:43.661145 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2eed00f-e526-4853-85cb-cb2a07be5793" path="/var/lib/kubelet/pods/d2eed00f-e526-4853-85cb-cb2a07be5793/volumes" Jul 10 21:03:43.765688 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:43.765653 2580 generic.go:356] "Generic (PLEG): container finished" podID="bbbc6c44-b146-430a-b6f5-71a22836472f" containerID="70fbea539e93821623977b9f6e76f2895c5f1b73e32a7793a5e18b1c75213020" exitCode=0 Jul 10 21:03:43.765688 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:43.765690 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7074-140567204547440" event={"ID":"bbbc6c44-b146-430a-b6f5-71a22836472f","Type":"ContainerDied","Data":"70fbea539e93821623977b9f6e76f2895c5f1b73e32a7793a5e18b1c75213020"} Jul 10 21:03:44.908397 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:44.908364 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567204547440" Jul 10 21:03:44.929005 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:44.928978 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7074-140567204547440_bbbc6c44-b146-430a-b6f5-71a22836472f/test-curl-7074-140567204547440/0.log" Jul 10 21:03:44.953117 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:44.953087 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7074-140567204547440"] Jul 10 21:03:44.956614 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:44.956591 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7074-140567204547440"] Jul 10 21:03:45.004296 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.004263 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4qzg\" (UniqueName: \"kubernetes.io/projected/bbbc6c44-b146-430a-b6f5-71a22836472f-kube-api-access-d4qzg\") pod \"bbbc6c44-b146-430a-b6f5-71a22836472f\" (UID: \"bbbc6c44-b146-430a-b6f5-71a22836472f\") " Jul 10 21:03:45.006246 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.006217 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbbc6c44-b146-430a-b6f5-71a22836472f-kube-api-access-d4qzg" (OuterVolumeSpecName: "kube-api-access-d4qzg") pod "bbbc6c44-b146-430a-b6f5-71a22836472f" (UID: "bbbc6c44-b146-430a-b6f5-71a22836472f"). InnerVolumeSpecName "kube-api-access-d4qzg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:03:45.080040 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.079936 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7074-140567204547440"] Jul 10 21:03:45.080834 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.080808 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbbc6c44-b146-430a-b6f5-71a22836472f" containerName="test-curl-7074-140567204547440" Jul 10 21:03:45.080834 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.080835 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbbc6c44-b146-430a-b6f5-71a22836472f" containerName="test-curl-7074-140567204547440" Jul 10 21:03:45.081672 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.081020 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbbc6c44-b146-430a-b6f5-71a22836472f" containerName="test-curl-7074-140567204547440" Jul 10 21:03:45.083922 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.083901 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567204547440" Jul 10 21:03:45.085019 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.084991 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7074-140567204547440"] Jul 10 21:03:45.105650 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.105624 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4qzg\" (UniqueName: \"kubernetes.io/projected/bbbc6c44-b146-430a-b6f5-71a22836472f-kube-api-access-d4qzg\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 21:03:45.207004 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.206971 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8kpr\" (UniqueName: \"kubernetes.io/projected/7c088f14-ac5f-4c21-b382-b65628d89131-kube-api-access-z8kpr\") pod \"test-curl-7074-140567204547440\" (UID: \"7c088f14-ac5f-4c21-b382-b65628d89131\") " pod="openshift-ingress/test-curl-7074-140567204547440" Jul 10 21:03:45.307484 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.307443 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8kpr\" (UniqueName: \"kubernetes.io/projected/7c088f14-ac5f-4c21-b382-b65628d89131-kube-api-access-z8kpr\") pod \"test-curl-7074-140567204547440\" (UID: \"7c088f14-ac5f-4c21-b382-b65628d89131\") " pod="openshift-ingress/test-curl-7074-140567204547440" Jul 10 21:03:45.326084 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.326047 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8kpr\" (UniqueName: \"kubernetes.io/projected/7c088f14-ac5f-4c21-b382-b65628d89131-kube-api-access-z8kpr\") pod \"test-curl-7074-140567204547440\" (UID: \"7c088f14-ac5f-4c21-b382-b65628d89131\") " pod="openshift-ingress/test-curl-7074-140567204547440" Jul 10 21:03:45.393331 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.393296 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567204547440" Jul 10 21:03:45.537931 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.537904 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7074-140567204547440"] Jul 10 21:03:45.540095 ip-10-0-133-6 kubenswrapper[2580]: W0710 21:03:45.540068 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c088f14_ac5f_4c21_b382_b65628d89131.slice/crio-1154ab156fc98edb0550fb6ea8be24f9f02ebecf4a21a93e8746bd194a4e075e WatchSource:0}: Error finding container 1154ab156fc98edb0550fb6ea8be24f9f02ebecf4a21a93e8746bd194a4e075e: Status 404 returned error can't find the container with id 1154ab156fc98edb0550fb6ea8be24f9f02ebecf4a21a93e8746bd194a4e075e Jul 10 21:03:45.661588 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.661492 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbbc6c44-b146-430a-b6f5-71a22836472f" path="/var/lib/kubelet/pods/bbbc6c44-b146-430a-b6f5-71a22836472f/volumes" Jul 10 21:03:45.780743 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.780699 2580 scope.go:117] "RemoveContainer" containerID="70fbea539e93821623977b9f6e76f2895c5f1b73e32a7793a5e18b1c75213020" Jul 10 21:03:45.780743 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.780716 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567204547440" Jul 10 21:03:45.782197 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:45.782045 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7074-140567204547440" event={"ID":"7c088f14-ac5f-4c21-b382-b65628d89131","Type":"ContainerStarted","Data":"1154ab156fc98edb0550fb6ea8be24f9f02ebecf4a21a93e8746bd194a4e075e"} Jul 10 21:03:46.789843 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:46.789809 2580 generic.go:356] "Generic (PLEG): container finished" podID="7c088f14-ac5f-4c21-b382-b65628d89131" containerID="5493a246b6ce08b7fc06cfce04d68ff31d643e26896f5b39265ff727b860af93" exitCode=0 Jul 10 21:03:46.790274 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:46.789895 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7074-140567204547440" event={"ID":"7c088f14-ac5f-4c21-b382-b65628d89131","Type":"ContainerDied","Data":"5493a246b6ce08b7fc06cfce04d68ff31d643e26896f5b39265ff727b860af93"} Jul 10 21:03:47.960656 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:47.960632 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567204547440" Jul 10 21:03:47.982253 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:47.982227 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7074-140567204547440_7c088f14-ac5f-4c21-b382-b65628d89131/test-curl-7074-140567204547440/0.log" Jul 10 21:03:48.007181 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:48.007151 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7074-140567204547440"] Jul 10 21:03:48.010869 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:48.010846 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7074-140567204547440"] Jul 10 21:03:48.038156 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:48.038100 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8kpr\" (UniqueName: \"kubernetes.io/projected/7c088f14-ac5f-4c21-b382-b65628d89131-kube-api-access-z8kpr\") pod \"7c088f14-ac5f-4c21-b382-b65628d89131\" (UID: \"7c088f14-ac5f-4c21-b382-b65628d89131\") " Jul 10 21:03:48.040169 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:48.040140 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c088f14-ac5f-4c21-b382-b65628d89131-kube-api-access-z8kpr" (OuterVolumeSpecName: "kube-api-access-z8kpr") pod "7c088f14-ac5f-4c21-b382-b65628d89131" (UID: "7c088f14-ac5f-4c21-b382-b65628d89131"). InnerVolumeSpecName "kube-api-access-z8kpr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 21:03:48.139900 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:48.139867 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8kpr\" (UniqueName: \"kubernetes.io/projected/7c088f14-ac5f-4c21-b382-b65628d89131-kube-api-access-z8kpr\") on node \"ip-10-0-133-6.ec2.internal\" DevicePath \"\"" Jul 10 21:03:48.802565 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:48.802536 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1154ab156fc98edb0550fb6ea8be24f9f02ebecf4a21a93e8746bd194a4e075e" Jul 10 21:03:48.802565 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:48.802543 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7074-140567204547440" Jul 10 21:03:48.812238 ip-10-0-133-6 kubenswrapper[2580]: E0710 21:03:48.812210 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7074-140567204547440\" is forbidden: User \"system:node:ip-10-0-133-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-6.ec2.internal' and this object" podUID="7c088f14-ac5f-4c21-b382-b65628d89131" pod="openshift-ingress/test-curl-7074-140567204547440" Jul 10 21:03:49.659225 ip-10-0-133-6 kubenswrapper[2580]: E0710 21:03:49.659185 2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7074-140567204547440\" is forbidden: User \"system:node:ip-10-0-133-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-133-6.ec2.internal' and this object" podUID="7c088f14-ac5f-4c21-b382-b65628d89131" pod="openshift-ingress/test-curl-7074-140567204547440" Jul 10 21:03:49.660415 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:03:49.660389 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c088f14-ac5f-4c21-b382-b65628d89131" path="/var/lib/kubelet/pods/7c088f14-ac5f-4c21-b382-b65628d89131/volumes" Jul 10 21:04:02.489997 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:02.489959 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69b8458b44-pzrxn_014e717d-5594-471b-b239-68810dee0395/authorino/0.log" Jul 10 21:04:07.910476 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:07.910443 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b6f977c45-s4x4q_36c35daf-316c-4e7e-b4b0-0022a64e26c6/copy-manifests/0.log" Jul 10 21:04:07.931589 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:07.931557 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b6f977c45-s4x4q_36c35daf-316c-4e7e-b4b0-0022a64e26c6/manager/0.log" Jul 10 21:04:09.149088 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:09.149059 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv_d3864b89-dd3c-4de2-8128-7a2ebad60ccc/util/0.log" Jul 10 21:04:09.156742 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:09.156716 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv_d3864b89-dd3c-4de2-8128-7a2ebad60ccc/pull/0.log" Jul 10 21:04:09.163860 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:09.163833 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv_d3864b89-dd3c-4de2-8128-7a2ebad60ccc/extract/0.log" Jul 10 21:04:09.266195 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:09.266160 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp_df564d34-8185-4241-b2ef-ecb915fa66ee/util/0.log" Jul 10 21:04:09.272868 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:09.272841 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp_df564d34-8185-4241-b2ef-ecb915fa66ee/pull/0.log" Jul 10 21:04:09.278997 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:09.278969 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp_df564d34-8185-4241-b2ef-ecb915fa66ee/extract/0.log" Jul 10 21:04:09.384747 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:09.384710 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m_fa8107cb-afc5-404b-9f6a-d9abcad758b9/util/0.log" Jul 10 21:04:09.391599 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:09.391567 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m_fa8107cb-afc5-404b-9f6a-d9abcad758b9/pull/0.log" Jul 10 21:04:09.399329 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:09.399257 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m_fa8107cb-afc5-404b-9f6a-d9abcad758b9/extract/0.log" Jul 10 21:04:09.502260 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:09.502225 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn_86d2f098-e563-4227-bd4c-69216ae2ab0b/extract/0.log" Jul 10 21:04:09.508843 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:09.508815 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn_86d2f098-e563-4227-bd4c-69216ae2ab0b/util/0.log" Jul 10 21:04:09.515721 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:09.515698 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn_86d2f098-e563-4227-bd4c-69216ae2ab0b/pull/0.log" Jul 10 21:04:09.634405 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:09.634369 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69b8458b44-pzrxn_014e717d-5594-471b-b239-68810dee0395/authorino/0.log" Jul 10 21:04:10.193584 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:10.193550 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6g867_34d991c8-08a5-4bdc-9bad-97e5ab51b078/manager/0.log" Jul 10 21:04:10.966655 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:10.966621 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b5fcf8fc5-cmdw6_2a97bcd0-37da-4969-a350-9d65007e20e9/kube-auth-proxy/0.log" Jul 10 21:04:11.848811 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:11.848779 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-xt78w_4549e5a9-b631-4fc9-9e45-b2e18f9c30b1/main/0.log" Jul 10 21:04:12.391376 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:12.391347 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-57t7w_b73885cb-39cc-477c-9309-935e43ea1e10/main/0.log" Jul 10 21:04:15.943064 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:15.943027 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n2z9x/must-gather-fhm55"] Jul 10 21:04:15.943472 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:15.943422 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c088f14-ac5f-4c21-b382-b65628d89131" containerName="test-curl-7074-140567204547440" Jul 10 21:04:15.943472 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:15.943434 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c088f14-ac5f-4c21-b382-b65628d89131" containerName="test-curl-7074-140567204547440" Jul 10 21:04:15.943546 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:15.943505 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c088f14-ac5f-4c21-b382-b65628d89131" containerName="test-curl-7074-140567204547440" Jul 10 21:04:15.951712 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:15.951682 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n2z9x/must-gather-fhm55" Jul 10 21:04:15.954581 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:15.954559 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n2z9x\"/\"default-dockercfg-kpjj7\"" Jul 10 21:04:15.955506 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:15.955486 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n2z9x\"/\"kube-root-ca.crt\"" Jul 10 21:04:15.955754 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:15.955737 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n2z9x\"/\"openshift-service-ca.crt\"" Jul 10 21:04:15.959849 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:15.959827 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n2z9x/must-gather-fhm55"] Jul 10 21:04:15.987408 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:15.987370 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/194875e5-cf49-4b2e-a076-833ee0e42870-must-gather-output\") pod \"must-gather-fhm55\" (UID: \"194875e5-cf49-4b2e-a076-833ee0e42870\") " pod="openshift-must-gather-n2z9x/must-gather-fhm55" Jul 10 21:04:15.987588 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:15.987432 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp25t\" (UniqueName: \"kubernetes.io/projected/194875e5-cf49-4b2e-a076-833ee0e42870-kube-api-access-hp25t\") pod \"must-gather-fhm55\" (UID: \"194875e5-cf49-4b2e-a076-833ee0e42870\") " pod="openshift-must-gather-n2z9x/must-gather-fhm55" Jul 10 21:04:16.088577 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:16.088535 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/194875e5-cf49-4b2e-a076-833ee0e42870-must-gather-output\") pod \"must-gather-fhm55\" (UID: \"194875e5-cf49-4b2e-a076-833ee0e42870\") " pod="openshift-must-gather-n2z9x/must-gather-fhm55" Jul 10 21:04:16.088757 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:16.088600 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp25t\" (UniqueName: \"kubernetes.io/projected/194875e5-cf49-4b2e-a076-833ee0e42870-kube-api-access-hp25t\") pod \"must-gather-fhm55\" (UID: \"194875e5-cf49-4b2e-a076-833ee0e42870\") " pod="openshift-must-gather-n2z9x/must-gather-fhm55" Jul 10 21:04:16.088913 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:16.088891 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/194875e5-cf49-4b2e-a076-833ee0e42870-must-gather-output\") pod \"must-gather-fhm55\" (UID: \"194875e5-cf49-4b2e-a076-833ee0e42870\") " pod="openshift-must-gather-n2z9x/must-gather-fhm55" Jul 10 21:04:16.097928 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:16.097894 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp25t\" (UniqueName: \"kubernetes.io/projected/194875e5-cf49-4b2e-a076-833ee0e42870-kube-api-access-hp25t\") pod \"must-gather-fhm55\" (UID: \"194875e5-cf49-4b2e-a076-833ee0e42870\") " pod="openshift-must-gather-n2z9x/must-gather-fhm55" Jul 10 21:04:16.262354 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:16.262260 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n2z9x/must-gather-fhm55" Jul 10 21:04:16.421982 ip-10-0-133-6 kubenswrapper[2580]: W0710 21:04:16.421952 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod194875e5_cf49_4b2e_a076_833ee0e42870.slice/crio-088302f2e14421da383acb53c5ffdbc49be84e6e081df66100413c7acda0d355 WatchSource:0}: Error finding container 088302f2e14421da383acb53c5ffdbc49be84e6e081df66100413c7acda0d355: Status 404 returned error can't find the container with id 088302f2e14421da383acb53c5ffdbc49be84e6e081df66100413c7acda0d355 Jul 10 21:04:16.422443 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:16.422420 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n2z9x/must-gather-fhm55"] Jul 10 21:04:16.958235 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:16.958201 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n2z9x/must-gather-fhm55" event={"ID":"194875e5-cf49-4b2e-a076-833ee0e42870","Type":"ContainerStarted","Data":"088302f2e14421da383acb53c5ffdbc49be84e6e081df66100413c7acda0d355"} Jul 10 21:04:17.966548 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:17.966507 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n2z9x/must-gather-fhm55" event={"ID":"194875e5-cf49-4b2e-a076-833ee0e42870","Type":"ContainerStarted","Data":"90a4bdd504434a8fb822b20ed51eda8c24ab219900c1bf347658b891088f952a"} Jul 10 21:04:17.966934 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:17.966564 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n2z9x/must-gather-fhm55" event={"ID":"194875e5-cf49-4b2e-a076-833ee0e42870","Type":"ContainerStarted","Data":"edb292345a53aad100f5765f90140afdd686e1a4b5095c3942df42ef3c6f4dad"} Jul 10 21:04:17.983753 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:17.983701 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n2z9x/must-gather-fhm55" podStartSLOduration=1.9131906779999999 podStartE2EDuration="2.983681783s" totalImagesPullingTime="1.070491105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 21:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:04:17.982517873 +0000 UTC m=+2579.442722699" watchObservedRunningTime="2026-07-10 21:04:17.983681783 +0000 UTC m=+2579.443886608" Jul 10 21:04:19.186147 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:19.186095 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cgjgd_54004500-c887-4445-ba31-1c7db58bbb4d/global-pull-secret-syncer/0.log" Jul 10 21:04:19.372727 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:19.372678 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nrjmp_439772ec-a894-482d-95aa-449e9db39ca7/konnectivity-agent/0.log" Jul 10 21:04:19.470660 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:19.470553 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-6.ec2.internal_423ffdfdc9b0aa9c91a91910587e3e86/haproxy/0.log" Jul 10 21:04:23.804949 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:23.804912 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv_d3864b89-dd3c-4de2-8128-7a2ebad60ccc/extract/0.log" Jul 10 21:04:23.829510 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:23.829478 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv_d3864b89-dd3c-4de2-8128-7a2ebad60ccc/util/0.log" Jul 10 21:04:23.854353 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:23.854317 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592dtnv_d3864b89-dd3c-4de2-8128-7a2ebad60ccc/pull/0.log" Jul 10 21:04:23.883949 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:23.883904 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp_df564d34-8185-4241-b2ef-ecb915fa66ee/extract/0.log" Jul 10 21:04:23.905948 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:23.905909 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp_df564d34-8185-4241-b2ef-ecb915fa66ee/util/0.log" Jul 10 21:04:23.931277 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:23.931242 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kfdjp_df564d34-8185-4241-b2ef-ecb915fa66ee/pull/0.log" Jul 10 21:04:23.960738 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:23.960696 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m_fa8107cb-afc5-404b-9f6a-d9abcad758b9/extract/0.log" Jul 10 21:04:23.986509 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:23.986479 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m_fa8107cb-afc5-404b-9f6a-d9abcad758b9/util/0.log" Jul 10 21:04:24.012261 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:24.012231 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73zq76m_fa8107cb-afc5-404b-9f6a-d9abcad758b9/pull/0.log" Jul 10 21:04:24.050179 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:24.050146 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn_86d2f098-e563-4227-bd4c-69216ae2ab0b/extract/0.log" Jul 10 21:04:24.077103 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:24.077010 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn_86d2f098-e563-4227-bd4c-69216ae2ab0b/util/0.log" Jul 10 21:04:24.113880 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:24.113842 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1vq6pn_86d2f098-e563-4227-bd4c-69216ae2ab0b/pull/0.log" Jul 10 21:04:24.688150 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:24.685388 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-69b8458b44-pzrxn_014e717d-5594-471b-b239-68810dee0395/authorino/0.log" Jul 10 21:04:25.017203 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:25.017070 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-6g867_34d991c8-08a5-4bdc-9bad-97e5ab51b078/manager/0.log" Jul 10 21:04:26.741795 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:26.741723 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa/alertmanager/0.log" Jul 10 21:04:26.766647 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:26.766618 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa/config-reloader/0.log" Jul 10 21:04:26.794866 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:26.794826 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa/kube-rbac-proxy-web/0.log" Jul 10 21:04:26.821445 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:26.821416 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa/kube-rbac-proxy/0.log" Jul 10 21:04:26.846733 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:26.846681 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa/kube-rbac-proxy-metric/0.log" Jul 10 21:04:26.873211 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:26.873098 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa/prom-label-proxy/0.log" Jul 10 21:04:26.898380 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:26.898344 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_94a17eb9-c2de-4bbe-b1e9-dbe2d8c389aa/init-config-reloader/0.log" Jul 10 21:04:26.945786 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:26.945748 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-jsrqs_9792b3e3-4f2d-47fc-bd39-7678a663e757/cluster-monitoring-operator/0.log" Jul 10 21:04:27.210740 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:27.210710 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4xvjn_af82c0ee-1d4c-4241-a521-7785a1473835/node-exporter/0.log" Jul 10 21:04:27.236509 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:27.236477 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4xvjn_af82c0ee-1d4c-4241-a521-7785a1473835/kube-rbac-proxy/0.log" Jul 10 21:04:27.258476 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:27.258449 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4xvjn_af82c0ee-1d4c-4241-a521-7785a1473835/init-textfile/0.log" Jul 10 21:04:27.360415 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:27.360383 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-jcqx6_4fe170b0-4b9f-4838-b34f-49ccd58c9ea1/kube-rbac-proxy-main/0.log" Jul 10 21:04:27.388277 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:27.388247 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-jcqx6_4fe170b0-4b9f-4838-b34f-49ccd58c9ea1/kube-rbac-proxy-self/0.log" Jul 10 21:04:27.412981 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:27.412945 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-jcqx6_4fe170b0-4b9f-4838-b34f-49ccd58c9ea1/openshift-state-metrics/0.log" Jul 10 21:04:27.681514 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:27.681472 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-86lbg_cf57315e-650b-46a7-8d5d-da94f6bf6c95/prometheus-operator-admission-webhook/0.log" Jul 10 21:04:27.791227 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:27.791182 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c4dbf6bc6-2kw29_68a2416b-0367-4440-8de7-4b53b4bdaee2/thanos-query/0.log" Jul 10 21:04:27.813333 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:27.813246 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c4dbf6bc6-2kw29_68a2416b-0367-4440-8de7-4b53b4bdaee2/kube-rbac-proxy-web/0.log" Jul 10 21:04:27.834832 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:27.834804 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c4dbf6bc6-2kw29_68a2416b-0367-4440-8de7-4b53b4bdaee2/kube-rbac-proxy/0.log" Jul 10 21:04:27.862644 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:27.862612 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c4dbf6bc6-2kw29_68a2416b-0367-4440-8de7-4b53b4bdaee2/prom-label-proxy/0.log" Jul 10 21:04:27.893878 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:27.893847 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c4dbf6bc6-2kw29_68a2416b-0367-4440-8de7-4b53b4bdaee2/kube-rbac-proxy-rules/0.log" Jul 10 21:04:27.915853 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:27.915822 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c4dbf6bc6-2kw29_68a2416b-0367-4440-8de7-4b53b4bdaee2/kube-rbac-proxy-metrics/0.log" Jul 10 21:04:30.026799 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.026747 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84"] Jul 10 21:04:30.032024 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.031988 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:30.046362 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.046327 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84"] Jul 10 21:04:30.152241 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.152200 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/85e1493e-55f6-450f-beb0-46eea3e93933-podres\") pod \"perf-node-gather-daemonset-rtg84\" (UID: \"85e1493e-55f6-450f-beb0-46eea3e93933\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:30.152572 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.152552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85e1493e-55f6-450f-beb0-46eea3e93933-sys\") pod \"perf-node-gather-daemonset-rtg84\" (UID: \"85e1493e-55f6-450f-beb0-46eea3e93933\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:30.152746 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.152726 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/85e1493e-55f6-450f-beb0-46eea3e93933-proc\") pod \"perf-node-gather-daemonset-rtg84\" (UID: \"85e1493e-55f6-450f-beb0-46eea3e93933\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:30.152951 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.152931 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nllpb\" (UniqueName: \"kubernetes.io/projected/85e1493e-55f6-450f-beb0-46eea3e93933-kube-api-access-nllpb\") pod \"perf-node-gather-daemonset-rtg84\" (UID: \"85e1493e-55f6-450f-beb0-46eea3e93933\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:30.153123 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.153106 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/85e1493e-55f6-450f-beb0-46eea3e93933-lib-modules\") pod \"perf-node-gather-daemonset-rtg84\" (UID: \"85e1493e-55f6-450f-beb0-46eea3e93933\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:30.196934 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.196902 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7796ddb6f5-5zwxf_bb848394-db03-494f-b800-2465bb43927f/console/0.log" Jul 10 21:04:30.247102 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.247069 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-p8f9b_177c3bf7-25be-4820-b836-44b4c969b0e1/download-server/0.log" Jul 10 21:04:30.254571 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.254524 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nllpb\" (UniqueName: \"kubernetes.io/projected/85e1493e-55f6-450f-beb0-46eea3e93933-kube-api-access-nllpb\") pod \"perf-node-gather-daemonset-rtg84\" (UID: \"85e1493e-55f6-450f-beb0-46eea3e93933\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:30.254571 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.254581 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/85e1493e-55f6-450f-beb0-46eea3e93933-lib-modules\") pod \"perf-node-gather-daemonset-rtg84\" (UID: \"85e1493e-55f6-450f-beb0-46eea3e93933\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:30.254867 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.254635 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/85e1493e-55f6-450f-beb0-46eea3e93933-podres\") pod \"perf-node-gather-daemonset-rtg84\" (UID: \"85e1493e-55f6-450f-beb0-46eea3e93933\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:30.254867 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.254680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85e1493e-55f6-450f-beb0-46eea3e93933-sys\") pod \"perf-node-gather-daemonset-rtg84\" (UID: \"85e1493e-55f6-450f-beb0-46eea3e93933\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:30.254867 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.254713 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/85e1493e-55f6-450f-beb0-46eea3e93933-proc\") pod \"perf-node-gather-daemonset-rtg84\" (UID: \"85e1493e-55f6-450f-beb0-46eea3e93933\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:30.254867 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.254732 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/85e1493e-55f6-450f-beb0-46eea3e93933-lib-modules\") pod \"perf-node-gather-daemonset-rtg84\" (UID: \"85e1493e-55f6-450f-beb0-46eea3e93933\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:30.254867 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.254796 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/85e1493e-55f6-450f-beb0-46eea3e93933-proc\") pod \"perf-node-gather-daemonset-rtg84\" (UID: \"85e1493e-55f6-450f-beb0-46eea3e93933\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:30.254867 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.254829 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/85e1493e-55f6-450f-beb0-46eea3e93933-podres\") pod \"perf-node-gather-daemonset-rtg84\" (UID: \"85e1493e-55f6-450f-beb0-46eea3e93933\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:30.254867 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.254844 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85e1493e-55f6-450f-beb0-46eea3e93933-sys\") pod \"perf-node-gather-daemonset-rtg84\" (UID: \"85e1493e-55f6-450f-beb0-46eea3e93933\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:30.262912 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.262883 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nllpb\" (UniqueName: \"kubernetes.io/projected/85e1493e-55f6-450f-beb0-46eea3e93933-kube-api-access-nllpb\") pod \"perf-node-gather-daemonset-rtg84\" (UID: \"85e1493e-55f6-450f-beb0-46eea3e93933\") " pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:30.349519 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.349416 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:30.531910 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.531874 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84"] Jul 10 21:04:30.906156 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:30.906097 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-jxkh6_87628fa9-06d0-42ae-a3aa-f5e2d2eedb83/volume-data-source-validator/0.log" Jul 10 21:04:31.088555 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:31.088457 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" event={"ID":"85e1493e-55f6-450f-beb0-46eea3e93933","Type":"ContainerStarted","Data":"d593142df4cd3ed9272fc6b8035142ddf48f7f7d765cb68011498c291f672c38"} Jul 10 21:04:31.088555 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:31.088528 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:31.088555 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:31.088553 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" event={"ID":"85e1493e-55f6-450f-beb0-46eea3e93933","Type":"ContainerStarted","Data":"a86fd2daeea4e9ae45265f64462f334afef53d4d6fe08ac4be7b79b1f98141fa"} Jul 10 21:04:31.125102 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:31.125044 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" podStartSLOduration=1.125024546 podStartE2EDuration="1.125024546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 21:04:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 21:04:31.123811347 +0000 UTC m=+2592.584016174" watchObservedRunningTime="2026-07-10 21:04:31.125024546 +0000 UTC m=+2592.585229372" Jul 10 21:04:32.124689 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:32.124660 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xjz7l_c32bbb4b-0f56-4f0c-971e-660dd1b6f01c/dns/0.log" Jul 10 21:04:32.167527 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:32.167492 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xjz7l_c32bbb4b-0f56-4f0c-971e-660dd1b6f01c/kube-rbac-proxy/0.log" Jul 10 21:04:32.196606 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:32.196579 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dlpg8_8f7b5179-aa27-496e-9181-5c85edf27e29/dns-node-resolver/0.log" Jul 10 21:04:32.890575 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:32.890542 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tq429_e4c479fa-abe8-4123-a651-449f41f51e85/node-ca/0.log" Jul 10 21:04:33.979053 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:33.979020 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b5fcf8fc5-cmdw6_2a97bcd0-37da-4969-a350-9d65007e20e9/kube-auth-proxy/0.log" Jul 10 21:04:34.889509 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:34.889466 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-scdn6_f14f7f56-76e3-419f-8465-2f708f109e31/serve-healthcheck-canary/0.log" Jul 10 21:04:35.436758 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:35.436723 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-flfd4_9a68b4c6-47ad-4089-a652-3420f5f7d02d/kube-rbac-proxy/0.log" Jul 10 21:04:35.457648 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:35.457620 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-flfd4_9a68b4c6-47ad-4089-a652-3420f5f7d02d/exporter/0.log" Jul 10 21:04:35.479689 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:35.479657 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-flfd4_9a68b4c6-47ad-4089-a652-3420f5f7d02d/extractor/0.log" Jul 10 21:04:37.107077 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:37.107049 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n2z9x/perf-node-gather-daemonset-rtg84" Jul 10 21:04:38.507711 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:38.507680 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b6f977c45-s4x4q_36c35daf-316c-4e7e-b4b0-0022a64e26c6/manager/0.log" Jul 10 21:04:38.527111 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:38.527077 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7b6f977c45-s4x4q_36c35daf-316c-4e7e-b4b0-0022a64e26c6/copy-manifests/0.log" Jul 10 21:04:39.982217 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:39.982188 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5dcfcfbc-c8f8d_7f4f5ece-2383-410b-a4ea-b3b4abdfec2d/manager/0.log" Jul 10 21:04:40.134985 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:40.134909 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b5fcf8fc5-cmdw6_2a97bcd0-37da-4969-a350-9d65007e20e9/kube-auth-proxy/0.log" Jul 10 21:04:41.551371 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:41.551345 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b5fcf8fc5-cmdw6_2a97bcd0-37da-4969-a350-9d65007e20e9/kube-auth-proxy/0.log" Jul 10 21:04:44.902432 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:44.902397 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-xkmck_2857c00b-21d2-44a0-8a84-6c17e2dfba24/migrator/0.log" Jul 10 21:04:44.923014 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:44.922988 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-xkmck_2857c00b-21d2-44a0-8a84-6c17e2dfba24/graceful-termination/0.log" Jul 10 21:04:45.281573 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:45.281497 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-6qcbf_d17091fb-5267-42d2-8683-3b26390a632b/kube-storage-version-migrator-operator/1.log" Jul 10 21:04:45.283351 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:45.283319 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-6qcbf_d17091fb-5267-42d2-8683-3b26390a632b/kube-storage-version-migrator-operator/0.log" Jul 10 21:04:46.765637 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:46.765608 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cgcl5_52d41eb6-7de4-4fd7-8ee6-fd0397982de4/kube-multus-additional-cni-plugins/0.log" Jul 10 21:04:46.789225 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:46.789201 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cgcl5_52d41eb6-7de4-4fd7-8ee6-fd0397982de4/egress-router-binary-copy/0.log" Jul 10 21:04:46.810311 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:46.810284 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cgcl5_52d41eb6-7de4-4fd7-8ee6-fd0397982de4/cni-plugins/0.log" Jul 10 21:04:46.832280 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:46.832251 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cgcl5_52d41eb6-7de4-4fd7-8ee6-fd0397982de4/bond-cni-plugin/0.log" Jul 10 21:04:46.852150 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:46.852110 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cgcl5_52d41eb6-7de4-4fd7-8ee6-fd0397982de4/routeoverride-cni/0.log" Jul 10 21:04:46.873087 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:46.873061 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cgcl5_52d41eb6-7de4-4fd7-8ee6-fd0397982de4/whereabouts-cni-bincopy/0.log" Jul 10 21:04:46.892650 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:46.892617 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cgcl5_52d41eb6-7de4-4fd7-8ee6-fd0397982de4/whereabouts-cni/0.log" Jul 10 21:04:46.963269 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:46.963206 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hbr6v_feb78f8a-7e80-4546-a840-3d15bc2dba14/kube-multus/0.log" Jul 10 21:04:47.080332 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:47.080256 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gsjgb_1d2a9a56-7498-4287-92d4-d6805d7fefa4/network-metrics-daemon/0.log" Jul 10 21:04:47.098829 ip-10-0-133-6 kubenswrapper[2580]: I0710 21:04:47.098798 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gsjgb_1d2a9a56-7498-4287-92d4-d6805d7fefa4/kube-rbac-proxy/0.log"