Jul 01 16:06:36.035030 ip-10-0-136-120 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 01 16:06:36.035044 ip-10-0-136-120 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 01 16:06:36.035054 ip-10-0-136-120 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 01 16:06:36.035351 ip-10-0-136-120 systemd[1]: Failed to start Kubernetes Kubelet. Jul 01 16:06:45.460173 ip-10-0-136-120 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 01 16:06:45.460190 ip-10-0-136-120 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot eb34c2c43b56444690182d141cdc43c5 -- Jul 01 16:08:31.847364 ip-10-0-136-120 systemd[1]: Starting Kubernetes Kubelet... Jul 01 16:08:32.280415 ip-10-0-136-120 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:08:32.280415 ip-10-0-136-120 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 16:08:32.280415 ip-10-0-136-120 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:08:32.280415 ip-10-0-136-120 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 16:08:32.280415 ip-10-0-136-120 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 16:08:32.280415 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.185186 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 16:08:32.280415 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189233 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:08:32.280415 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189250 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:08:32.280415 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189254 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:08:32.280415 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189257 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:08:32.280415 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189261 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:08:32.280415 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189266 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:08:32.280415 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189270 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:08:32.280415 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189274 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:08:32.260301 ip-10-0-136-120 systemd[1]: Started Kubernetes Kubelet. Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189277 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189280 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189283 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189285 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189288 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189290 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189294 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189298 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189301 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189305 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189308 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189311 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189316 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189319 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189322 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189325 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189329 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189331 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189334 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:08:32.282779 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189339 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189343 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189345 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189349 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189352 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189355 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189359 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189362 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189366 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189369 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189371 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189376 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189379 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189381 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189384 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189388 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189391 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189393 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189397 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189401 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189404 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:08:32.283785 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189407 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189410 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189413 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189416 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189419 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189422 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189426 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189432 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189437 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189440 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189444 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189448 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189452 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189456 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189460 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189463 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189467 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189470 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189473 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:08:32.467888 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189477 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189481 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189484 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189486 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189490 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189493 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189495 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189498 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189501 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189505 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189508 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189512 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189515 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189518 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189521 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189525 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189527 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189530 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189533 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189537 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:08:32.490100 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189539 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189542 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189544 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189548 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189551 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189555 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189559 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189563 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189566 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189569 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189572 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.189576 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191058 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191068 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191073 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191077 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191080 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191085 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191088 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:08:32.490804 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191091 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191095 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191099 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191101 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191104 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191109 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191113 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191116 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191121 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191123 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191126 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191130 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191133 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191137 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191140 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191144 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191147 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191151 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191155 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:08:32.491550 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191159 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191166 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191170 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191174 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191178 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191181 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191184 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191188 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191191 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191193 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191197 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191200 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191203 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191207 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191211 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191214 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191216 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191220 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191223 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:08:32.492190 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191225 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191228 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191237 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191242 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191245 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191249 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191253 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191256 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191259 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191263 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191267 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191270 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191273 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191276 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191279 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191281 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191284 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191288 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191291 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191293 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:08:32.493138 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191296 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191299 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191302 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191304 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191307 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191310 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191314 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191316 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191319 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191323 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191325 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191327 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191330 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191334 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191338 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191341 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191345 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191348 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191350 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:08:32.493943 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191353 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191355 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191358 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191360 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191364 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191368 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191370 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191372 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191376 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191379 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191381 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191385 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191389 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191392 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.191395 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192284 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192291 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192295 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192298 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192303 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:08:32.494688 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192305 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192308 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192312 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192316 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192319 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192321 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192324 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192329 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192332 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192337 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192341 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192344 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192348 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192351 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192354 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192357 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192361 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192364 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192367 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:08:32.498755 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192371 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192375 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192378 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192382 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192385 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192388 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192390 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192393 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192395 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192398 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192400 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192404 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192406 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192409 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192413 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192416 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192419 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192422 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192425 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192429 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:08:32.499491 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192433 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192437 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192441 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192443 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192446 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192450 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192452 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192456 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192461 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192465 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192468 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192471 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192475 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192478 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192480 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192484 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192487 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192490 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192494 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:08:32.500177 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192497 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192500 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192503 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192507 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192510 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192513 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192516 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192520 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192523 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192526 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192530 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192533 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192536 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192540 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192544 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192546 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192552 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192555 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192558 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192560 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:08:32.500845 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192564 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192567 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192569 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192572 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192576 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192578 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192581 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192584 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192587 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192590 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192593 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192595 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192598 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192600 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192603 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.192607 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192683 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192692 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192701 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192707 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192714 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 16:08:32.501399 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192719 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192725 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192731 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192735 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192740 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192744 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192748 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192753 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192758 2564 flags.go:64] FLAG: --cgroup-root="" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192761 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192764 2564 flags.go:64] FLAG: --client-ca-file="" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192768 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192771 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192789 2564 flags.go:64] FLAG: --cluster-domain="" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192793 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192797 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192800 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192803 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192807 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192811 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192815 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192818 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192822 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192826 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 16:08:32.501971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192829 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192833 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192837 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192842 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192846 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192849 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192852 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192855 2564 flags.go:64] FLAG: --enable-server="true" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192861 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192868 2564 flags.go:64] FLAG: --event-burst="100" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192872 2564 flags.go:64] FLAG: --event-qps="50" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192875 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192882 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192886 2564 flags.go:64] FLAG: --eviction-hard="" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192891 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192895 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192898 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192903 2564 flags.go:64] FLAG: --eviction-soft="" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192906 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192909 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192913 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192917 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192920 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192923 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192928 2564 flags.go:64] FLAG: --feature-gates="" Jul 01 16:08:32.502583 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192932 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192936 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192940 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192944 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192948 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192952 2564 flags.go:64] FLAG: --help="false" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192955 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192958 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192962 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192966 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192970 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192974 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192977 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192981 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192985 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192988 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192993 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192997 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.192999 2564 flags.go:64] FLAG: --kube-reserved="" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193012 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193015 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193019 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193024 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193026 2564 flags.go:64] FLAG: --lock-file="" Jul 01 16:08:32.503268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193030 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193034 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193037 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193045 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193048 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193052 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193056 2564 flags.go:64] FLAG: --logging-format="text" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193060 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193064 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193068 2564 flags.go:64] FLAG: --manifest-url="" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193071 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193077 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193080 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193084 2564 flags.go:64] FLAG: --max-pods="110" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193088 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193091 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193094 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193098 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193102 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193106 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193109 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193118 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193121 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193125 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 16:08:32.503926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193129 2564 flags.go:64] FLAG: --pod-cidr="" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193133 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193139 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193145 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193149 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193151 2564 flags.go:64] FLAG: --port="10250" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193155 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193161 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07e0640b175a5213a" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193164 2564 flags.go:64] FLAG: --qos-reserved="" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193169 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193172 2564 flags.go:64] FLAG: --register-node="true" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193175 2564 flags.go:64] FLAG: --register-with-taints="" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193183 2564 flags.go:64] FLAG: --registry-burst="10" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193187 2564 flags.go:64] FLAG: --registry-qps="5" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193191 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193195 2564 flags.go:64] FLAG: --reserved-memory="" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193199 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193204 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193207 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193210 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193213 2564 flags.go:64] FLAG: --runonce="false" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193216 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193219 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193223 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193226 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 16:08:32.504594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193229 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193233 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193237 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193241 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193244 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193248 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193252 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193255 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193259 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193262 2564 flags.go:64] FLAG: --system-cgroups="" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193268 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193274 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193278 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193282 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193287 2564 flags.go:64] FLAG: --tls-min-version="" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193291 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193294 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193297 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193301 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193305 2564 flags.go:64] FLAG: --v="2" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193310 2564 flags.go:64] FLAG: --version="false" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193315 2564 flags.go:64] FLAG: --vmodule="" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193318 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.193322 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193455 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:08:32.505312 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193461 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193464 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193467 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193470 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193474 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193477 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193479 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193484 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193486 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193489 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193494 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193498 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193502 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193506 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193510 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193513 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193515 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193523 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193526 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:08:32.505996 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193530 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193533 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193537 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193541 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193544 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193546 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193549 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193553 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193555 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193558 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193562 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193565 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193568 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193570 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193574 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193577 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193580 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193582 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193586 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193589 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:08:32.506489 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193591 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193594 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193597 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193600 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193603 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193606 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193610 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193612 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193615 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193617 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193621 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193644 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193648 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193653 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193658 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193660 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193664 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193667 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193670 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193672 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:08:32.507037 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193676 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193679 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193681 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193684 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193687 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193690 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193693 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193695 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193699 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193702 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193704 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193707 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193710 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193713 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193716 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193718 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193722 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193725 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193728 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193730 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:08:32.507565 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193734 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193738 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193743 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193747 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193751 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193753 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193758 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193761 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193763 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193766 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193770 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193772 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193788 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193792 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193795 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193797 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193800 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193805 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:08:32.508182 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.193809 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:08:32.508658 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.194331 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:08:32.508658 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.200956 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 16:08:32.508658 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.200972 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 16:08:32.508658 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.200992 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 16:08:32.508658 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.200998 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 16:08:32.508658 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201077 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:08:32.508658 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201084 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:08:32.508658 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201089 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:08:32.508658 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201094 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:08:32.508658 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201099 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:08:32.508658 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201103 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:08:32.508658 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201107 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:08:32.508658 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201111 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:08:32.508658 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201116 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:08:32.508658 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201120 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201124 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201128 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201132 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201136 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201141 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201144 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201148 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201152 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201155 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201159 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201163 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201166 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201170 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201174 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201177 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201182 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201186 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201190 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201194 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:08:32.509090 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201199 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201203 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201208 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201211 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201215 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201219 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201223 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201227 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201231 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201234 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201238 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201242 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201246 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201250 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201254 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201257 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201261 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201265 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201269 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201273 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:08:32.509610 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201278 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201282 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201286 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201290 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201295 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201299 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201302 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201306 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201310 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201314 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201319 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201322 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201327 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201331 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201335 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201339 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201343 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201346 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201350 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201353 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:08:32.510150 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201357 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201362 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201366 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201369 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201373 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201378 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201382 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201385 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201389 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201393 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201396 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201400 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201404 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201408 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201412 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201415 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201419 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201423 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201427 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201433 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:08:32.510717 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201437 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:08:32.511264 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201443 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:08:32.511264 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201448 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:08:32.511264 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201452 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:08:32.511264 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201455 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:08:32.511264 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201461 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:08:32.511264 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201466 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:08:32.511264 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201471 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:08:32.511264 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201475 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:08:32.511264 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201479 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:08:32.511264 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.201484 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:08:32.511264 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201641 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 16:08:32.511264 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201648 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 16:08:32.511264 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201652 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 16:08:32.511264 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201656 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201663 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201667 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201671 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201675 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201679 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201684 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201688 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201691 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201693 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201696 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201700 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201704 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201707 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201711 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201715 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201719 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201722 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201728 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 16:08:32.511646 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201731 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201735 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201739 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201742 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201746 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201750 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201754 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201757 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201762 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201765 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201769 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201772 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201793 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201797 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201806 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201810 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201814 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201818 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201821 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 16:08:32.512266 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201827 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201831 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201835 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201839 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201843 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201848 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201851 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201856 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201859 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201863 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201867 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201870 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201875 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201879 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201882 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201886 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201889 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201894 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201897 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201900 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 16:08:32.514961 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201903 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201907 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201910 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201914 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201918 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201922 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201925 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201930 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201935 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201938 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201942 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201946 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201951 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201956 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201960 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201964 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201968 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201972 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201976 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201980 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 16:08:32.515555 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201984 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 16:08:32.516153 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201988 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 16:08:32.516153 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201993 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 16:08:32.516153 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.201997 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 16:08:32.516153 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.202002 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 16:08:32.516153 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.202006 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 16:08:32.516153 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.202010 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 16:08:32.516153 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.202013 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 16:08:32.516153 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.202017 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 16:08:32.516153 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.202021 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 16:08:32.516153 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.202025 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 16:08:32.516153 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.202028 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 16:08:32.516153 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.202032 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 16:08:32.516153 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.202036 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 16:08:32.516153 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.202040 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 16:08:32.516153 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.202044 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 16:08:32.516153 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.202048 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 16:08:32.516153 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:32.202051 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 16:08:32.516644 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.202058 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 16:08:32.516644 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.202211 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 16:08:32.516644 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.205309 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 16:08:32.516644 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.206640 2564 server.go:1019] "Starting client certificate rotation" Jul 01 16:08:32.516644 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.206733 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 16:08:32.516644 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.206769 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 16:08:32.516644 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.209492 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 16:08:32.516644 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.210600 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 16:08:32.516644 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.224986 2564 log.go:25] "Validated CRI v1 runtime API" Jul 01 16:08:32.516644 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.227132 2564 log.go:25] "Validated CRI v1 image API" Jul 01 16:08:32.516644 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.227905 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 16:08:32.516644 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.230932 2564 fs.go:135] Filesystem UUIDs: map[2714bdf1-3f61-4c2c-85f4-877ce98a3d0c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c38ac27a-fe7a-4474-9376-c6b6aa9245d9:/dev/nvme0n1p4] Jul 01 16:08:32.517041 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.230954 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 16:08:32.517041 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.235875 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.237150 2564 manager.go:216] Machine: {Timestamp:2026-07-01 16:08:32.235967672 +0000 UTC m=+0.288105657 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100931 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23dba204682b9cc6b8cb09e7825f9d SystemUUID:ec23dba2-0468-2b9c-c6b8-cb09e7825f9d BootID:eb34c2c4-3b56-4446-9018-2d141cdc43c5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:74:2c:40:ab:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:74:2c:40:ab:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:25:e9:1b:48:c3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.237266 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.237364 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.240056 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.240088 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-120.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.240760 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.240772 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.240794 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.241866 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.242661 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.246846 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.246966 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.246994 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.247004 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.247018 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.247027 2564 kubelet.go:398] "Adding apiserver pod source" Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.247037 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 16:08:32.517108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.247359 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.247373 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.251155 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.252885 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.252913 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.253810 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.253825 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.253831 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.253843 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.253853 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.253858 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.253867 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.253873 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.253881 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.253887 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.253901 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.253912 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.253937 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.253943 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.259119 2564 server.go:1268] "Started kubelet" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.259197 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.259494 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.259551 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.259952 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7n9rg" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.262651 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.264938 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.265280 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.266530 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-120.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.267033 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-120.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.267034 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.266563 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-120.ec2.internal.18be3636fb64693e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-120.ec2.internal,UID:ip-10-0-136-120.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-120.ec2.internal,},FirstTimestamp:2026-07-01 16:08:32.25909075 +0000 UTC m=+0.311228733,LastTimestamp:2026-07-01 16:08:32.25909075 +0000 UTC m=+0.311228733,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-120.ec2.internal,}" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.268990 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7n9rg" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.270631 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.271039 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.271137 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.271587 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.271587 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.271616 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.271719 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 01 16:08:32.517626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.271730 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.271909 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.271920 2564 factory.go:55] Registering systemd factory Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.271927 2564 factory.go:223] Registration of the systemd container factory successfully Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.272132 2564 factory.go:153] Registering CRI-O factory Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.272146 2564 factory.go:223] Registration of the crio container factory successfully Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.272172 2564 factory.go:103] Registering Raw factory Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.272183 2564 manager.go:1196] Started watching for new ooms in manager Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.272541 2564 manager.go:349] Starting recovery of all containers Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.281655 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.281691 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-120.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.289352 2564 manager.go:354] Recovery completed Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.296246 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.298670 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.298699 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.298714 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.299356 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.299368 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.299377 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.299388 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.300093 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.300120 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.300131 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.301708 2564 policy_none.go:49] "None policy: Start" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.301722 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.301733 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.303902 2564 policy_none.go:47] "Start" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.350487 2564 manager.go:337] "Starting Device Plugin manager" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.350521 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.350533 2564 server.go:87] "Starting device plugin registration server" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.350848 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.350875 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.350994 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.351095 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.351104 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.351631 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.351629 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.351691 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-120.ec2.internal\" not found" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.352966 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.353015 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.353041 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.353080 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.355424 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.456138 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal"] Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.456256 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.456146 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.457296 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:08:32.518695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.457327 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.457343 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.457376 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.457848 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.457874 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.457887 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.460247 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.460372 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.460417 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.461029 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.461034 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.461062 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.461076 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.461063 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.461227 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.463916 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.463940 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.464664 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientMemory" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.464695 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.464710 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeHasSufficientPID" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.466547 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.466566 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-120.ec2.internal\": node \"ip-10-0-136-120.ec2.internal\" not found" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.473047 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4c211cb0255824f1a3b31f696afaf86f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-120.ec2.internal\" (UID: \"4c211cb0255824f1a3b31f696afaf86f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.473080 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5e6dc586ae03b71729dd0e738df60a1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal\" (UID: \"b5e6dc586ae03b71729dd0e738df60a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.473104 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e6dc586ae03b71729dd0e738df60a1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal\" (UID: \"b5e6dc586ae03b71729dd0e738df60a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.480589 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.494035 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-120.ec2.internal\" not found" node="ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.519994 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.502268 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-120.ec2.internal\" not found" node="ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.573509 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.573469 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4c211cb0255824f1a3b31f696afaf86f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-120.ec2.internal\" (UID: \"4c211cb0255824f1a3b31f696afaf86f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.573509 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.573504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5e6dc586ae03b71729dd0e738df60a1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal\" (UID: \"b5e6dc586ae03b71729dd0e738df60a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.573704 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.573525 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e6dc586ae03b71729dd0e738df60a1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal\" (UID: \"b5e6dc586ae03b71729dd0e738df60a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.573704 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.573572 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5e6dc586ae03b71729dd0e738df60a1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal\" (UID: \"b5e6dc586ae03b71729dd0e738df60a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.573704 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.573581 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4c211cb0255824f1a3b31f696afaf86f-config\") pod \"kube-apiserver-proxy-ip-10-0-136-120.ec2.internal\" (UID: \"4c211cb0255824f1a3b31f696afaf86f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.573704 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.573643 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e6dc586ae03b71729dd0e738df60a1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal\" (UID: \"b5e6dc586ae03b71729dd0e738df60a1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.581822 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.581798 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 01 16:08:32.682416 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.682366 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 01 16:08:32.783449 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.783368 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 01 16:08:32.797592 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.797555 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.805126 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:32.805106 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" Jul 01 16:08:32.884128 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.884078 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 01 16:08:32.985128 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:32.985105 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 01 16:08:33.086273 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:33.086171 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 01 16:08:33.186993 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:33.186960 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 01 16:08:33.206605 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:33.206567 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 16:08:33.206763 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:33.206744 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 16:08:33.281265 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:33.281092 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 16:03:32 +0000 UTC" deadline="2027-12-05 17:47:07.898071877 +0000 UTC" Jul 01 16:08:33.281265 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:33.281254 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12529h38m34.616822799s" Jul 01 16:08:33.287565 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:33.287543 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 01 16:08:33.332562 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:33.332531 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:08:33.388230 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:33.388207 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 01 16:08:33.489633 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:33.489285 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 01 16:08:33.499637 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:33.499598 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e6dc586ae03b71729dd0e738df60a1.slice/crio-1590b9587163be299b42f027a2964ec6e47ca8bb9ccbbca4e635b96d42881ef2 WatchSource:0}: Error finding container 1590b9587163be299b42f027a2964ec6e47ca8bb9ccbbca4e635b96d42881ef2: Status 404 returned error can't find the container with id 1590b9587163be299b42f027a2964ec6e47ca8bb9ccbbca4e635b96d42881ef2 Jul 01 16:08:33.504752 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:33.504724 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:08:33.545676 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:33.544539 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:08:33.557476 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:33.557450 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c211cb0255824f1a3b31f696afaf86f.slice/crio-1a8eb8bfdcfd56f0fb6a0a57c31abd8acbbe6b34378d023764e6805a7d663826 WatchSource:0}: Error finding container 1a8eb8bfdcfd56f0fb6a0a57c31abd8acbbe6b34378d023764e6805a7d663826: Status 404 returned error can't find the container with id 1a8eb8bfdcfd56f0fb6a0a57c31abd8acbbe6b34378d023764e6805a7d663826 Jul 01 16:08:33.589688 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:33.589640 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 01 16:08:33.690592 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:33.690515 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 01 16:08:33.791150 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:33.791115 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-120.ec2.internal\" not found" Jul 01 16:08:33.809415 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:33.809386 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:08:33.873290 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:33.873238 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" Jul 01 16:08:33.886186 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:33.886155 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 16:08:33.887045 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:33.887029 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" Jul 01 16:08:33.896820 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:33.896779 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 16:08:34.226296 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.226265 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 16:08:34.249060 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.249026 2564 apiserver.go:52] "Watching apiserver" Jul 01 16:08:34.260233 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.260200 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 16:08:34.260837 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.260813 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-fjb2v","kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal","openshift-cluster-node-tuning-operator/tuned-b4dp8","openshift-dns/node-resolver-9hlsb","openshift-image-registry/node-ca-kxwbh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal","openshift-multus/multus-additional-cni-plugins-xcz47","openshift-multus/network-metrics-daemon-xffss","kube-system/global-pull-secret-syncer-7p2nk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx","openshift-multus/multus-zt8cg","openshift-network-diagnostics/network-check-target-b9tls","openshift-network-operator/iptables-alerter-fp5kh","openshift-ovn-kubernetes/ovnkube-node-g6vrq"] Jul 01 16:08:34.263706 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.263682 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.266447 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.266424 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fp5kh" Jul 01 16:08:34.267283 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.267262 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4nrcz\"" Jul 01 16:08:34.267371 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.267349 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 16:08:34.267450 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.267430 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 16:08:34.267515 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.267498 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 16:08:34.267681 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.267620 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 16:08:34.267821 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.267702 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 16:08:34.269263 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.269117 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.269884 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.269857 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:08:34.270089 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.270072 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 16:08:34.270544 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.270526 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 16:08:34.270723 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.270709 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wkqvc\"" Jul 01 16:08:34.271981 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.271308 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 16:08:34.271981 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.271970 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9hlsb" Jul 01 16:08:34.272696 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.272676 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:08:34.272886 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.272726 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sdhdl\"" Jul 01 16:08:34.272960 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.272911 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 16:08:34.274969 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.274950 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 16:08:34.275470 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.275274 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 16:08:34.275470 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.275296 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-svqpf\"" Jul 01 16:08:34.277292 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.276807 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kxwbh" Jul 01 16:08:34.279736 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.279716 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 16:08:34.280419 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.280078 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 16:08:34.280419 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.280214 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8m965\"" Jul 01 16:08:34.280419 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.280259 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 16:08:34.289466 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.287662 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 16:08:34.289466 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288071 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-sysctl-conf\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.289466 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-lib-modules\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.289466 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288158 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-host\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.289466 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288195 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-system-cni-dir\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.289466 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288226 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-os-release\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.289466 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288259 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-sys\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.289466 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288287 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.289466 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288296 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29bcabe0-180d-4de5-95fc-6f62746f3847-host-slash\") pod \"iptables-alerter-fp5kh\" (UID: \"29bcabe0-180d-4de5-95fc-6f62746f3847\") " pod="openshift-network-operator/iptables-alerter-fp5kh" Jul 01 16:08:34.289466 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288322 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n84n7\" (UniqueName: \"kubernetes.io/projected/29bcabe0-180d-4de5-95fc-6f62746f3847-kube-api-access-n84n7\") pod \"iptables-alerter-fp5kh\" (UID: \"29bcabe0-180d-4de5-95fc-6f62746f3847\") " pod="openshift-network-operator/iptables-alerter-fp5kh" Jul 01 16:08:34.289466 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288401 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-var-lib-kubelet\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.289466 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288504 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wjgd\" (UniqueName: \"kubernetes.io/projected/b4251a7f-62ed-4a87-b76b-f9ad941199a8-kube-api-access-5wjgd\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.289466 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288550 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.289466 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288585 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-run\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.289466 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288618 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-modprobe-d\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.289466 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288649 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b-hosts-file\") pod \"node-resolver-9hlsb\" (UID: \"bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b\") " pod="openshift-dns/node-resolver-9hlsb" Jul 01 16:08:34.289466 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288682 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b-tmp-dir\") pod \"node-resolver-9hlsb\" (UID: \"bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b\") " pod="openshift-dns/node-resolver-9hlsb" Jul 01 16:08:34.290599 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288712 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-tuned\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.290599 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288742 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plqs4\" (UniqueName: \"kubernetes.io/projected/bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b-kube-api-access-plqs4\") pod \"node-resolver-9hlsb\" (UID: \"bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b\") " pod="openshift-dns/node-resolver-9hlsb" Jul 01 16:08:34.290599 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288772 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7f787d9-3e7b-490b-a193-80ac2c5b8d3d-host\") pod \"node-ca-kxwbh\" (UID: \"a7f787d9-3e7b-490b-a193-80ac2c5b8d3d\") " pod="openshift-image-registry/node-ca-kxwbh" Jul 01 16:08:34.290599 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288832 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7f787d9-3e7b-490b-a193-80ac2c5b8d3d-serviceca\") pod \"node-ca-kxwbh\" (UID: \"a7f787d9-3e7b-490b-a193-80ac2c5b8d3d\") " pod="openshift-image-registry/node-ca-kxwbh" Jul 01 16:08:34.290599 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288893 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29bcabe0-180d-4de5-95fc-6f62746f3847-iptables-alerter-script\") pod \"iptables-alerter-fp5kh\" (UID: \"29bcabe0-180d-4de5-95fc-6f62746f3847\") " pod="openshift-network-operator/iptables-alerter-fp5kh" Jul 01 16:08:34.290599 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288921 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-kubernetes\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.290599 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.288954 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgc98\" (UniqueName: \"kubernetes.io/projected/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-kube-api-access-vgc98\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.290599 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.289026 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-sysctl-d\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.290599 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.289125 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4251a7f-62ed-4a87-b76b-f9ad941199a8-tmp\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.290599 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.289194 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-cnibin\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.290599 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.289229 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-systemd\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.290599 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.289285 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-sysconfig\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.290599 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.289345 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6qnj\" (UniqueName: \"kubernetes.io/projected/a7f787d9-3e7b-490b-a193-80ac2c5b8d3d-kube-api-access-s6qnj\") pod \"node-ca-kxwbh\" (UID: \"a7f787d9-3e7b-490b-a193-80ac2c5b8d3d\") " pod="openshift-image-registry/node-ca-kxwbh" Jul 01 16:08:34.290599 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.289407 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-cni-binary-copy\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.290599 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.289543 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:34.290599 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:34.289635 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p2nk" podUID="3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1" Jul 01 16:08:34.290599 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.289445 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.291401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.289737 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.291401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.291249 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 16:08:34.291813 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.291756 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 16:08:34.292053 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.291990 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 16:08:34.293690 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.293348 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fjb2v" Jul 01 16:08:34.293690 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.293466 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 16:08:34.293690 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.293474 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 16:08:34.293690 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.293542 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 16:08:34.293690 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.293467 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p5mvt\"" Jul 01 16:08:34.296118 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.296096 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 16:08:34.296710 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.296690 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 16:08:34.297106 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.296922 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-phhrz\"" Jul 01 16:08:34.297329 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.297310 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:34.297427 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:34.297388 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:08:34.299672 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.299285 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.302339 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.302318 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.302721 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.302462 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m9p7v\"" Jul 01 16:08:34.302721 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.302577 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 16:08:34.302721 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.302683 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 16:08:34.302969 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.302819 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 16:08:34.304358 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.304327 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:34.304493 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:34.304403 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b9tls" podUID="f6b6e3ee-d314-4aff-8cc8-833388db7f3f" Jul 01 16:08:34.305456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.305437 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 16:08:34.305708 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.305543 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jrq6f\"" Jul 01 16:08:34.305708 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.305612 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5cf42" Jul 01 16:08:34.314502 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.314148 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5cf42" Jul 01 16:08:34.361829 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.361774 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" event={"ID":"4c211cb0255824f1a3b31f696afaf86f","Type":"ContainerStarted","Data":"1a8eb8bfdcfd56f0fb6a0a57c31abd8acbbe6b34378d023764e6805a7d663826"} Jul 01 16:08:34.363225 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.363199 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" event={"ID":"b5e6dc586ae03b71729dd0e738df60a1","Type":"ContainerStarted","Data":"1590b9587163be299b42f027a2964ec6e47ca8bb9ccbbca4e635b96d42881ef2"} Jul 01 16:08:34.374738 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.374667 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 16:08:34.389954 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.389926 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-var-lib-cni-multus\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.390112 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.389973 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-dbus\") pod \"global-pull-secret-syncer-7p2nk\" (UID: \"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1\") " pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:34.390112 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.390006 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-sysctl-d\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.390112 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.390037 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4251a7f-62ed-4a87-b76b-f9ad941199a8-tmp\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.390284 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.390132 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-cnibin\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.390284 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.390201 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-cnibin\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.390284 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.390214 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-sysctl-d\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.390284 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.390223 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-hostroot\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.390284 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.390266 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-kubelet\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.390533 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.390321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-systemd\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.390533 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.390353 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6qnj\" (UniqueName: \"kubernetes.io/projected/a7f787d9-3e7b-490b-a193-80ac2c5b8d3d-kube-api-access-s6qnj\") pod \"node-ca-kxwbh\" (UID: \"a7f787d9-3e7b-490b-a193-80ac2c5b8d3d\") " pod="openshift-image-registry/node-ca-kxwbh" Jul 01 16:08:34.390533 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.390391 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 16:08:34.390533 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.390422 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-systemd\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.390533 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.390464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-cni-binary-copy\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.391002 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.390982 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-run-openvswitch\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.391082 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.391020 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-cni-bin\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.392684 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.391047 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz58s\" (UniqueName: \"kubernetes.io/projected/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-kube-api-access-fz58s\") pod \"network-metrics-daemon-xffss\" (UID: \"92a3b32f-42e1-4747-8b1d-5a20ed0e7c02\") " pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:34.398165 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.394653 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-sys-fs\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.398165 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.394701 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4brc2\" (UniqueName: \"kubernetes.io/projected/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-kube-api-access-4brc2\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.398165 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.394739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-sysctl-conf\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.398165 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.394772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-system-cni-dir\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.398165 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.394798 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-run-netns\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.398165 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.394830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b566220a-4b5f-4fae-99c1-288d1b902fcf-multus-daemon-config\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.398165 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.394880 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-node-log\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.398165 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.394911 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d23ea488-6e17-4aa2-969e-f1ac3b448006-ovnkube-script-lib\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.398165 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.394945 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29bcabe0-180d-4de5-95fc-6f62746f3847-host-slash\") pod \"iptables-alerter-fp5kh\" (UID: \"29bcabe0-180d-4de5-95fc-6f62746f3847\") " pod="openshift-network-operator/iptables-alerter-fp5kh" Jul 01 16:08:34.398165 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.394974 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n84n7\" (UniqueName: \"kubernetes.io/projected/29bcabe0-180d-4de5-95fc-6f62746f3847-kube-api-access-n84n7\") pod \"iptables-alerter-fp5kh\" (UID: \"29bcabe0-180d-4de5-95fc-6f62746f3847\") " pod="openshift-network-operator/iptables-alerter-fp5kh" Jul 01 16:08:34.398165 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395011 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wjgd\" (UniqueName: \"kubernetes.io/projected/b4251a7f-62ed-4a87-b76b-f9ad941199a8-kube-api-access-5wjgd\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.398165 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.398165 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395075 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b566220a-4b5f-4fae-99c1-288d1b902fcf-cni-binary-copy\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.398165 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-registration-dir\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.398165 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395130 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-etc-selinux\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.398165 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395160 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-multus-cni-dir\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.399023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395190 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-multus-conf-dir\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.399023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-slash\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.399023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d23ea488-6e17-4aa2-969e-f1ac3b448006-ovnkube-config\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.399023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395283 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret\") pod \"global-pull-secret-syncer-7p2nk\" (UID: \"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1\") " pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:34.399023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395322 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b-tmp-dir\") pod \"node-resolver-9hlsb\" (UID: \"bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b\") " pod="openshift-dns/node-resolver-9hlsb" Jul 01 16:08:34.399023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-cnibin\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.399023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395381 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-systemd-units\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.399023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-run-ovn-kubernetes\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.399023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395442 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjtbj\" (UniqueName: \"kubernetes.io/projected/d23ea488-6e17-4aa2-969e-f1ac3b448006-kube-api-access-rjtbj\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.399023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-tuned\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.399023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7f787d9-3e7b-490b-a193-80ac2c5b8d3d-host\") pod \"node-ca-kxwbh\" (UID: \"a7f787d9-3e7b-490b-a193-80ac2c5b8d3d\") " pod="openshift-image-registry/node-ca-kxwbh" Jul 01 16:08:34.399023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7f787d9-3e7b-490b-a193-80ac2c5b8d3d-serviceca\") pod \"node-ca-kxwbh\" (UID: \"a7f787d9-3e7b-490b-a193-80ac2c5b8d3d\") " pod="openshift-image-registry/node-ca-kxwbh" Jul 01 16:08:34.399023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395569 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-run-k8s-cni-cncf-io\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.399023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395607 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29bcabe0-180d-4de5-95fc-6f62746f3847-iptables-alerter-script\") pod \"iptables-alerter-fp5kh\" (UID: \"29bcabe0-180d-4de5-95fc-6f62746f3847\") " pod="openshift-network-operator/iptables-alerter-fp5kh" Jul 01 16:08:34.399023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395640 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgc98\" (UniqueName: \"kubernetes.io/projected/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-kube-api-access-vgc98\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.399023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395675 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-os-release\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.399023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395713 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-system-cni-dir\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.399885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395744 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-multus-socket-dir-parent\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.399885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395769 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-etc-kubernetes\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.399885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395803 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.399885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395836 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d915b269-fc52-4ea6-aa37-4eecff380f0c-konnectivity-ca\") pod \"konnectivity-agent-fjb2v\" (UID: \"d915b269-fc52-4ea6-aa37-4eecff380f0c\") " pod="kube-system/konnectivity-agent-fjb2v" Jul 01 16:08:34.399885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395884 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs\") pod \"network-metrics-daemon-xffss\" (UID: \"92a3b32f-42e1-4747-8b1d-5a20ed0e7c02\") " pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:34.399885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-sysconfig\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.399885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.399885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.395980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.399885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396012 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-etc-openvswitch\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.399885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396044 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-cni-netd\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.399885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396073 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d23ea488-6e17-4aa2-969e-f1ac3b448006-ovn-node-metrics-cert\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.399885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-lib-modules\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.399885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396138 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-host\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.399885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396176 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-os-release\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.399885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396208 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-run-netns\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.399885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396235 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-run-systemd\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.400624 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396292 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-sys\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.400624 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396327 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-var-lib-kubelet\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.400624 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396358 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-log-socket\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.400624 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396390 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d23ea488-6e17-4aa2-969e-f1ac3b448006-env-overrides\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.400624 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396418 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-kubelet-config\") pod \"global-pull-secret-syncer-7p2nk\" (UID: \"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1\") " pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:34.400624 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396458 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-run\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.400624 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396489 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-var-lib-cni-bin\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.400624 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396521 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-run-multus-certs\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.400624 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396554 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr5zr\" (UniqueName: \"kubernetes.io/projected/b566220a-4b5f-4fae-99c1-288d1b902fcf-kube-api-access-vr5zr\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.400624 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396582 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-var-lib-openvswitch\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.400624 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396615 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-run-ovn\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.400624 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396650 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d915b269-fc52-4ea6-aa37-4eecff380f0c-agent-certs\") pod \"konnectivity-agent-fjb2v\" (UID: \"d915b269-fc52-4ea6-aa37-4eecff380f0c\") " pod="kube-system/konnectivity-agent-fjb2v" Jul 01 16:08:34.400624 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396687 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-socket-dir\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.400624 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396715 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-modprobe-d\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.400624 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396782 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b-hosts-file\") pod \"node-resolver-9hlsb\" (UID: \"bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b\") " pod="openshift-dns/node-resolver-9hlsb" Jul 01 16:08:34.400624 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396818 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xt2v7\" (UniqueName: \"kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7\") pod \"network-check-target-b9tls\" (UID: \"f6b6e3ee-d314-4aff-8cc8-833388db7f3f\") " pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:34.400624 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396869 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.401473 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396912 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-device-dir\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.401473 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396948 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plqs4\" (UniqueName: \"kubernetes.io/projected/bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b-kube-api-access-plqs4\") pod \"node-resolver-9hlsb\" (UID: \"bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b\") " pod="openshift-dns/node-resolver-9hlsb" Jul 01 16:08:34.401473 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.396982 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-var-lib-kubelet\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.401473 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.397019 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-kubernetes\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.401473 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.397182 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-kubernetes\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.401473 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.397338 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-sysctl-conf\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.401473 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.397398 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-system-cni-dir\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.401473 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.397511 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29bcabe0-180d-4de5-95fc-6f62746f3847-host-slash\") pod \"iptables-alerter-fp5kh\" (UID: \"29bcabe0-180d-4de5-95fc-6f62746f3847\") " pod="openshift-network-operator/iptables-alerter-fp5kh" Jul 01 16:08:34.401473 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.399775 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.401473 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.400244 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b-tmp-dir\") pod \"node-resolver-9hlsb\" (UID: \"bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b\") " pod="openshift-dns/node-resolver-9hlsb" Jul 01 16:08:34.401473 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.401164 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4251a7f-62ed-4a87-b76b-f9ad941199a8-tmp\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.401473 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.401168 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-cni-binary-copy\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.403270 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.401534 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-host\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.403270 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.401620 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-sysconfig\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.403270 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.401723 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a7f787d9-3e7b-490b-a193-80ac2c5b8d3d-serviceca\") pod \"node-ca-kxwbh\" (UID: \"a7f787d9-3e7b-490b-a193-80ac2c5b8d3d\") " pod="openshift-image-registry/node-ca-kxwbh" Jul 01 16:08:34.403270 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.401782 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-lib-modules\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.403270 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.401794 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.403270 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.401879 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-os-release\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.403270 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.401923 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a7f787d9-3e7b-490b-a193-80ac2c5b8d3d-host\") pod \"node-ca-kxwbh\" (UID: \"a7f787d9-3e7b-490b-a193-80ac2c5b8d3d\") " pod="openshift-image-registry/node-ca-kxwbh" Jul 01 16:08:34.403270 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.402229 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.403270 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.402417 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b-hosts-file\") pod \"node-resolver-9hlsb\" (UID: \"bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b\") " pod="openshift-dns/node-resolver-9hlsb" Jul 01 16:08:34.403270 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.402541 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-var-lib-kubelet\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.403270 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.402721 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-modprobe-d\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.403270 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.402951 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29bcabe0-180d-4de5-95fc-6f62746f3847-iptables-alerter-script\") pod \"iptables-alerter-fp5kh\" (UID: \"29bcabe0-180d-4de5-95fc-6f62746f3847\") " pod="openshift-network-operator/iptables-alerter-fp5kh" Jul 01 16:08:34.403885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.403580 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-sys\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.404146 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.404093 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b4251a7f-62ed-4a87-b76b-f9ad941199a8-run\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.413244 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.413217 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b4251a7f-62ed-4a87-b76b-f9ad941199a8-etc-tuned\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.414088 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.414062 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wjgd\" (UniqueName: \"kubernetes.io/projected/b4251a7f-62ed-4a87-b76b-f9ad941199a8-kube-api-access-5wjgd\") pod \"tuned-b4dp8\" (UID: \"b4251a7f-62ed-4a87-b76b-f9ad941199a8\") " pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.414842 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.414816 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n84n7\" (UniqueName: \"kubernetes.io/projected/29bcabe0-180d-4de5-95fc-6f62746f3847-kube-api-access-n84n7\") pod \"iptables-alerter-fp5kh\" (UID: \"29bcabe0-180d-4de5-95fc-6f62746f3847\") " pod="openshift-network-operator/iptables-alerter-fp5kh" Jul 01 16:08:34.416949 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.416713 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plqs4\" (UniqueName: \"kubernetes.io/projected/bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b-kube-api-access-plqs4\") pod \"node-resolver-9hlsb\" (UID: \"bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b\") " pod="openshift-dns/node-resolver-9hlsb" Jul 01 16:08:34.420360 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.420335 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgc98\" (UniqueName: \"kubernetes.io/projected/dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b-kube-api-access-vgc98\") pod \"multus-additional-cni-plugins-xcz47\" (UID: \"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b\") " pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.420777 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.420755 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6qnj\" (UniqueName: \"kubernetes.io/projected/a7f787d9-3e7b-490b-a193-80ac2c5b8d3d-kube-api-access-s6qnj\") pod \"node-ca-kxwbh\" (UID: \"a7f787d9-3e7b-490b-a193-80ac2c5b8d3d\") " pod="openshift-image-registry/node-ca-kxwbh" Jul 01 16:08:34.497545 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.497455 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-run-k8s-cni-cncf-io\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.497545 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.497503 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-os-release\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.497545 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.497524 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-run-k8s-cni-cncf-io\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.497874 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.497533 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-system-cni-dir\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.497874 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.497619 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-os-release\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.497874 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.497629 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-multus-socket-dir-parent\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.497874 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.497604 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-system-cni-dir\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.497874 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.497655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-etc-kubernetes\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.497874 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.497675 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.497874 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.497698 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d915b269-fc52-4ea6-aa37-4eecff380f0c-konnectivity-ca\") pod \"konnectivity-agent-fjb2v\" (UID: \"d915b269-fc52-4ea6-aa37-4eecff380f0c\") " pod="kube-system/konnectivity-agent-fjb2v" Jul 01 16:08:34.497874 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.497723 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs\") pod \"network-metrics-daemon-xffss\" (UID: \"92a3b32f-42e1-4747-8b1d-5a20ed0e7c02\") " pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:34.497874 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.497734 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-etc-kubernetes\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.497874 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.497760 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-etc-openvswitch\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.497874 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.497809 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-multus-socket-dir-parent\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.497918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-cni-netd\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.497956 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d23ea488-6e17-4aa2-969e-f1ac3b448006-ovn-node-metrics-cert\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.497994 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-run-netns\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498020 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-run-systemd\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-log-socket\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498073 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d23ea488-6e17-4aa2-969e-f1ac3b448006-env-overrides\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498098 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-kubelet-config\") pod \"global-pull-secret-syncer-7p2nk\" (UID: \"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1\") " pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498125 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-var-lib-cni-bin\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-run-multus-certs\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498182 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr5zr\" (UniqueName: \"kubernetes.io/projected/b566220a-4b5f-4fae-99c1-288d1b902fcf-kube-api-access-vr5zr\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498206 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-var-lib-openvswitch\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498251 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-log-socket\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498260 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-run-multus-certs\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498254 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-var-lib-cni-bin\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498308 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-cni-netd\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498386 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d915b269-fc52-4ea6-aa37-4eecff380f0c-konnectivity-ca\") pod \"konnectivity-agent-fjb2v\" (UID: \"d915b269-fc52-4ea6-aa37-4eecff380f0c\") " pod="kube-system/konnectivity-agent-fjb2v" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498418 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-run-netns\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.498499 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498454 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-run-ovn\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.499401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498458 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-run-systemd\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.499401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d915b269-fc52-4ea6-aa37-4eecff380f0c-agent-certs\") pod \"konnectivity-agent-fjb2v\" (UID: \"d915b269-fc52-4ea6-aa37-4eecff380f0c\") " pod="kube-system/konnectivity-agent-fjb2v" Jul 01 16:08:34.499401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498514 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-socket-dir\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.499401 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:34.498543 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:34.499401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498552 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-run-ovn\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.499401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498560 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-var-lib-openvswitch\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.499401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498584 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt2v7\" (UniqueName: \"kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7\") pod \"network-check-target-b9tls\" (UID: \"f6b6e3ee-d314-4aff-8cc8-833388db7f3f\") " pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:34.499401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498622 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-socket-dir\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.499401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498628 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-kubelet-config\") pod \"global-pull-secret-syncer-7p2nk\" (UID: \"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1\") " pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:34.499401 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:34.498627 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs podName:92a3b32f-42e1-4747-8b1d-5a20ed0e7c02 nodeName:}" failed. No retries permitted until 2026-07-01 16:08:34.998603664 +0000 UTC m=+3.050741656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs") pod "network-metrics-daemon-xffss" (UID: "92a3b32f-42e1-4747-8b1d-5a20ed0e7c02") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:34.499401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498660 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.499401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498673 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-etc-openvswitch\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.499401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498687 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-device-dir\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.499401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498712 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.499401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498715 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-var-lib-kubelet\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.499401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498754 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-var-lib-kubelet\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.499401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498795 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-var-lib-cni-multus\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.500456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498808 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.500456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498756 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-var-lib-cni-multus\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.500456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498872 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-dbus\") pod \"global-pull-secret-syncer-7p2nk\" (UID: \"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1\") " pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:34.500456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498904 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-hostroot\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.500456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498932 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-kubelet\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.500456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498959 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-run-openvswitch\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.500456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-cni-bin\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.500456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498991 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-hostroot\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.500456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.498873 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-device-dir\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.500456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499006 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz58s\" (UniqueName: \"kubernetes.io/projected/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-kube-api-access-fz58s\") pod \"network-metrics-daemon-xffss\" (UID: \"92a3b32f-42e1-4747-8b1d-5a20ed0e7c02\") " pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:34.500456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499032 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-dbus\") pod \"global-pull-secret-syncer-7p2nk\" (UID: \"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1\") " pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:34.500456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499043 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-run-openvswitch\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.500456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499070 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-sys-fs\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.500456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499093 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-cni-bin\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.500456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499098 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4brc2\" (UniqueName: \"kubernetes.io/projected/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-kube-api-access-4brc2\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.500456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499135 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-run-netns\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.500456 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499143 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d23ea488-6e17-4aa2-969e-f1ac3b448006-env-overrides\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.501363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499165 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b566220a-4b5f-4fae-99c1-288d1b902fcf-multus-daemon-config\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.501363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499151 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-kubelet\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.501363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499191 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-node-log\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.501363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499202 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-host-run-netns\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.501363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499215 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d23ea488-6e17-4aa2-969e-f1ac3b448006-ovnkube-script-lib\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.501363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499248 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b566220a-4b5f-4fae-99c1-288d1b902fcf-cni-binary-copy\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.501363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499250 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-sys-fs\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.501363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499274 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-registration-dir\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.501363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499301 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-etc-selinux\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.501363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499325 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-multus-cni-dir\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.501363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-multus-conf-dir\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.501363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499379 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-slash\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.501363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499384 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-registration-dir\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.501363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499248 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-node-log\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.501363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499403 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d23ea488-6e17-4aa2-969e-f1ac3b448006-ovnkube-config\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.501363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499435 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret\") pod \"global-pull-secret-syncer-7p2nk\" (UID: \"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1\") " pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:34.501363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499445 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-etc-selinux\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.502206 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-cnibin\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.502206 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-systemd-units\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.502206 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499521 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-run-ovn-kubernetes\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.502206 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:34.499532 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:34.502206 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499550 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjtbj\" (UniqueName: \"kubernetes.io/projected/d23ea488-6e17-4aa2-969e-f1ac3b448006-kube-api-access-rjtbj\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.502206 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:34.499605 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret podName:3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1 nodeName:}" failed. No retries permitted until 2026-07-01 16:08:34.99958158 +0000 UTC m=+3.051719561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret") pod "global-pull-secret-syncer-7p2nk" (UID: "3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:34.502206 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499659 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-systemd-units\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.502206 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499714 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-cnibin\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.502206 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499760 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-run-ovn-kubernetes\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.502206 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499776 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d23ea488-6e17-4aa2-969e-f1ac3b448006-ovnkube-script-lib\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.502206 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499778 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b566220a-4b5f-4fae-99c1-288d1b902fcf-multus-daemon-config\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.502206 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499806 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-multus-conf-dir\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.502206 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499875 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d23ea488-6e17-4aa2-969e-f1ac3b448006-host-slash\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.502206 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499884 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b566220a-4b5f-4fae-99c1-288d1b902fcf-multus-cni-dir\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.502206 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.499955 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d23ea488-6e17-4aa2-969e-f1ac3b448006-ovnkube-config\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.502206 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.500383 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b566220a-4b5f-4fae-99c1-288d1b902fcf-cni-binary-copy\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.502206 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.502126 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d23ea488-6e17-4aa2-969e-f1ac3b448006-ovn-node-metrics-cert\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.502823 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.502249 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d915b269-fc52-4ea6-aa37-4eecff380f0c-agent-certs\") pod \"konnectivity-agent-fjb2v\" (UID: \"d915b269-fc52-4ea6-aa37-4eecff380f0c\") " pod="kube-system/konnectivity-agent-fjb2v" Jul 01 16:08:34.508637 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:34.508610 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:08:34.508637 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:34.508637 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:08:34.508637 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:34.508653 2564 projected.go:196] Error preparing data for projected volume kube-api-access-xt2v7 for pod openshift-network-diagnostics/network-check-target-b9tls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:34.508937 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:34.508719 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7 podName:f6b6e3ee-d314-4aff-8cc8-833388db7f3f nodeName:}" failed. No retries permitted until 2026-07-01 16:08:35.008700096 +0000 UTC m=+3.060838091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xt2v7" (UniqueName: "kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7") pod "network-check-target-b9tls" (UID: "f6b6e3ee-d314-4aff-8cc8-833388db7f3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:34.511775 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.511718 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz58s\" (UniqueName: \"kubernetes.io/projected/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-kube-api-access-fz58s\") pod \"network-metrics-daemon-xffss\" (UID: \"92a3b32f-42e1-4747-8b1d-5a20ed0e7c02\") " pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:34.511896 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.511797 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr5zr\" (UniqueName: \"kubernetes.io/projected/b566220a-4b5f-4fae-99c1-288d1b902fcf-kube-api-access-vr5zr\") pod \"multus-zt8cg\" (UID: \"b566220a-4b5f-4fae-99c1-288d1b902fcf\") " pod="openshift-multus/multus-zt8cg" Jul 01 16:08:34.512092 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.512070 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjtbj\" (UniqueName: \"kubernetes.io/projected/d23ea488-6e17-4aa2-969e-f1ac3b448006-kube-api-access-rjtbj\") pod \"ovnkube-node-g6vrq\" (UID: \"d23ea488-6e17-4aa2-969e-f1ac3b448006\") " pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.513837 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.513799 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4brc2\" (UniqueName: \"kubernetes.io/projected/279e1c2d-08e3-4900-9804-48bbbc1cbbdc-kube-api-access-4brc2\") pod \"aws-ebs-csi-driver-node-bd8xx\" (UID: \"279e1c2d-08e3-4900-9804-48bbbc1cbbdc\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.586137 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.586100 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xcz47" Jul 01 16:08:34.589279 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.589245 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fp5kh" Jul 01 16:08:34.607140 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.607109 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" Jul 01 16:08:34.616143 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.616120 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9hlsb" Jul 01 16:08:34.625193 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.625167 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kxwbh" Jul 01 16:08:34.637040 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.637013 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:34.644128 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.644102 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fjb2v" Jul 01 16:08:34.655195 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.655165 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" Jul 01 16:08:34.662241 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:34.662214 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zt8cg" Jul 01 16:08:35.003589 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:35.003553 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs\") pod \"network-metrics-daemon-xffss\" (UID: \"92a3b32f-42e1-4747-8b1d-5a20ed0e7c02\") " pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:35.003826 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:35.003650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret\") pod \"global-pull-secret-syncer-7p2nk\" (UID: \"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1\") " pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:35.003826 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:35.003733 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:35.003826 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:35.003760 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:35.004007 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:35.003836 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret podName:3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1 nodeName:}" failed. No retries permitted until 2026-07-01 16:08:36.003798029 +0000 UTC m=+4.055936003 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret") pod "global-pull-secret-syncer-7p2nk" (UID: "3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:35.004007 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:35.003857 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs podName:92a3b32f-42e1-4747-8b1d-5a20ed0e7c02 nodeName:}" failed. No retries permitted until 2026-07-01 16:08:36.003847423 +0000 UTC m=+4.055985397 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs") pod "network-metrics-daemon-xffss" (UID: "92a3b32f-42e1-4747-8b1d-5a20ed0e7c02") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:35.104769 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:35.104733 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt2v7\" (UniqueName: \"kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7\") pod \"network-check-target-b9tls\" (UID: \"f6b6e3ee-d314-4aff-8cc8-833388db7f3f\") " pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:35.104980 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:35.104901 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:08:35.104980 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:35.104924 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:08:35.104980 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:35.104935 2564 projected.go:196] Error preparing data for projected volume kube-api-access-xt2v7 for pod openshift-network-diagnostics/network-check-target-b9tls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:35.105115 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:35.105016 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7 podName:f6b6e3ee-d314-4aff-8cc8-833388db7f3f nodeName:}" failed. No retries permitted until 2026-07-01 16:08:36.105001617 +0000 UTC m=+4.157139589 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xt2v7" (UniqueName: "kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7") pod "network-check-target-b9tls" (UID: "f6b6e3ee-d314-4aff-8cc8-833388db7f3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:35.317707 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:35.317604 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:03:34 +0000 UTC" deadline="2028-02-18 15:03:42.777687068 +0000 UTC" Jul 01 16:08:35.317707 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:35.317650 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14326h55m7.460047271s" Jul 01 16:08:35.353561 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:35.353523 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:35.353746 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:35.353673 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:08:35.509189 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:35.509157 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f787d9_3e7b_490b_a193_80ac2c5b8d3d.slice/crio-e75407656d08d2d6c57a393fc738e6e76bb657669f2c077a3ed8f66fd7b0e566 WatchSource:0}: Error finding container e75407656d08d2d6c57a393fc738e6e76bb657669f2c077a3ed8f66fd7b0e566: Status 404 returned error can't find the container with id e75407656d08d2d6c57a393fc738e6e76bb657669f2c077a3ed8f66fd7b0e566 Jul 01 16:08:35.510147 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:35.510117 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4251a7f_62ed_4a87_b76b_f9ad941199a8.slice/crio-95a8b7795e269817e5f6722360282bd92e871d88cafc20efe45774b44db41e7f WatchSource:0}: Error finding container 95a8b7795e269817e5f6722360282bd92e871d88cafc20efe45774b44db41e7f: Status 404 returned error can't find the container with id 95a8b7795e269817e5f6722360282bd92e871d88cafc20efe45774b44db41e7f Jul 01 16:08:35.534048 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:35.534014 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd4aeddd_e9ce_47a5_8bce_fdfad39ed39b.slice/crio-bcac023c9b20aed06685e7e10b9796dec9301ca29a902279b7a64240b8b3bd90 WatchSource:0}: Error finding container bcac023c9b20aed06685e7e10b9796dec9301ca29a902279b7a64240b8b3bd90: Status 404 returned error can't find the container with id bcac023c9b20aed06685e7e10b9796dec9301ca29a902279b7a64240b8b3bd90 Jul 01 16:08:35.534732 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:35.534709 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd915b269_fc52_4ea6_aa37_4eecff380f0c.slice/crio-6f31c89e8589f4bfaff9ffa939d4f21408775580c616ea5d282a7404051d3b43 WatchSource:0}: Error finding container 6f31c89e8589f4bfaff9ffa939d4f21408775580c616ea5d282a7404051d3b43: Status 404 returned error can't find the container with id 6f31c89e8589f4bfaff9ffa939d4f21408775580c616ea5d282a7404051d3b43 Jul 01 16:08:35.536497 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:35.536469 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb566220a_4b5f_4fae_99c1_288d1b902fcf.slice/crio-817ff0f1ee903c50ced56fb14455bf5578e745d2173b69595486eaa50c515276 WatchSource:0}: Error finding container 817ff0f1ee903c50ced56fb14455bf5578e745d2173b69595486eaa50c515276: Status 404 returned error can't find the container with id 817ff0f1ee903c50ced56fb14455bf5578e745d2173b69595486eaa50c515276 Jul 01 16:08:35.537694 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:35.537661 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29bcabe0_180d_4de5_95fc_6f62746f3847.slice/crio-16d771b938e85ab74fdc8b1cfe32b16260182e145e02766bb493f5435d54ae10 WatchSource:0}: Error finding container 16d771b938e85ab74fdc8b1cfe32b16260182e145e02766bb493f5435d54ae10: Status 404 returned error can't find the container with id 16d771b938e85ab74fdc8b1cfe32b16260182e145e02766bb493f5435d54ae10 Jul 01 16:08:35.539340 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:08:35.539082 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod279e1c2d_08e3_4900_9804_48bbbc1cbbdc.slice/crio-193975c15b48cfeef4b4be9de3d6359e82055dae2994d035902e444a19553d15 WatchSource:0}: Error finding container 193975c15b48cfeef4b4be9de3d6359e82055dae2994d035902e444a19553d15: Status 404 returned error can't find the container with id 193975c15b48cfeef4b4be9de3d6359e82055dae2994d035902e444a19553d15 Jul 01 16:08:36.011372 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.011276 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret\") pod \"global-pull-secret-syncer-7p2nk\" (UID: \"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1\") " pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:36.011372 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.011340 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs\") pod \"network-metrics-daemon-xffss\" (UID: \"92a3b32f-42e1-4747-8b1d-5a20ed0e7c02\") " pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:36.011620 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:36.011446 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:36.011620 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:36.011478 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:36.011620 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:36.011533 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret podName:3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1 nodeName:}" failed. No retries permitted until 2026-07-01 16:08:38.01150872 +0000 UTC m=+6.063646694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret") pod "global-pull-secret-syncer-7p2nk" (UID: "3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:36.011620 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:36.011553 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs podName:92a3b32f-42e1-4747-8b1d-5a20ed0e7c02 nodeName:}" failed. No retries permitted until 2026-07-01 16:08:38.011544578 +0000 UTC m=+6.063682551 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs") pod "network-metrics-daemon-xffss" (UID: "92a3b32f-42e1-4747-8b1d-5a20ed0e7c02") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:36.111756 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.111716 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt2v7\" (UniqueName: \"kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7\") pod \"network-check-target-b9tls\" (UID: \"f6b6e3ee-d314-4aff-8cc8-833388db7f3f\") " pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:36.111975 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:36.111956 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:08:36.112044 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:36.111987 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:08:36.112044 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:36.112002 2564 projected.go:196] Error preparing data for projected volume kube-api-access-xt2v7 for pod openshift-network-diagnostics/network-check-target-b9tls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:36.112153 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:36.112068 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7 podName:f6b6e3ee-d314-4aff-8cc8-833388db7f3f nodeName:}" failed. No retries permitted until 2026-07-01 16:08:38.11204726 +0000 UTC m=+6.164185258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xt2v7" (UniqueName: "kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7") pod "network-check-target-b9tls" (UID: "f6b6e3ee-d314-4aff-8cc8-833388db7f3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:36.318285 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.318145 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 16:03:34 +0000 UTC" deadline="2027-12-03 19:46:20.363987541 +0000 UTC" Jul 01 16:08:36.318285 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.318234 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12483h37m44.045757538s" Jul 01 16:08:36.356603 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.355261 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:36.356603 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:36.355664 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p2nk" podUID="3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1" Jul 01 16:08:36.356603 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.356116 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:36.356603 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:36.356223 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b9tls" podUID="f6b6e3ee-d314-4aff-8cc8-833388db7f3f" Jul 01 16:08:36.376329 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.376291 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" event={"ID":"4c211cb0255824f1a3b31f696afaf86f","Type":"ContainerStarted","Data":"7b0b803e2dd96e7e51a35beaa55192d1ebfd83a0a7d9658290efffd02b432f16"} Jul 01 16:08:36.385180 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.385139 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcz47" event={"ID":"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b","Type":"ContainerStarted","Data":"c4b0ff4461a4a633b00a5869e0faa3ace5d4316073df47ad309f59999ffacb86"} Jul 01 16:08:36.398969 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.398906 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-120.ec2.internal" podStartSLOduration=2.39888599 podStartE2EDuration="2.39888599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:36.398406016 +0000 UTC m=+4.450544013" watchObservedRunningTime="2026-07-01 16:08:36.39888599 +0000 UTC m=+4.451023990" Jul 01 16:08:36.405782 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.405745 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fp5kh" event={"ID":"29bcabe0-180d-4de5-95fc-6f62746f3847","Type":"ContainerStarted","Data":"16d771b938e85ab74fdc8b1cfe32b16260182e145e02766bb493f5435d54ae10"} Jul 01 16:08:36.411596 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.411562 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fjb2v" event={"ID":"d915b269-fc52-4ea6-aa37-4eecff380f0c","Type":"ContainerStarted","Data":"6f31c89e8589f4bfaff9ffa939d4f21408775580c616ea5d282a7404051d3b43"} Jul 01 16:08:36.416139 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.416108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9hlsb" event={"ID":"bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b","Type":"ContainerStarted","Data":"bcac023c9b20aed06685e7e10b9796dec9301ca29a902279b7a64240b8b3bd90"} Jul 01 16:08:36.420556 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.420526 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kxwbh" event={"ID":"a7f787d9-3e7b-490b-a193-80ac2c5b8d3d","Type":"ContainerStarted","Data":"e75407656d08d2d6c57a393fc738e6e76bb657669f2c077a3ed8f66fd7b0e566"} Jul 01 16:08:36.423443 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.423415 2564 generic.go:356] "Generic (PLEG): container finished" podID="b5e6dc586ae03b71729dd0e738df60a1" containerID="a2a9a9c171f7c5c5dfab7f1e1baf16399ab513bb01bac8c40c4a9618098c2039" exitCode=0 Jul 01 16:08:36.423553 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.423495 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" event={"ID":"b5e6dc586ae03b71729dd0e738df60a1","Type":"ContainerDied","Data":"a2a9a9c171f7c5c5dfab7f1e1baf16399ab513bb01bac8c40c4a9618098c2039"} Jul 01 16:08:36.430032 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.429888 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" event={"ID":"d23ea488-6e17-4aa2-969e-f1ac3b448006","Type":"ContainerStarted","Data":"85667de630f19b3ebc1a94e7782479bdb16fd09ceb0ba5d118eed81175ee121d"} Jul 01 16:08:36.433564 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.433295 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" event={"ID":"279e1c2d-08e3-4900-9804-48bbbc1cbbdc","Type":"ContainerStarted","Data":"193975c15b48cfeef4b4be9de3d6359e82055dae2994d035902e444a19553d15"} Jul 01 16:08:36.435237 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.435214 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zt8cg" event={"ID":"b566220a-4b5f-4fae-99c1-288d1b902fcf","Type":"ContainerStarted","Data":"817ff0f1ee903c50ced56fb14455bf5578e745d2173b69595486eaa50c515276"} Jul 01 16:08:36.443227 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:36.443160 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" event={"ID":"b4251a7f-62ed-4a87-b76b-f9ad941199a8","Type":"ContainerStarted","Data":"95a8b7795e269817e5f6722360282bd92e871d88cafc20efe45774b44db41e7f"} Jul 01 16:08:37.353839 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:37.353806 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:37.354322 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:37.353950 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:08:37.493356 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:37.493315 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" event={"ID":"b5e6dc586ae03b71729dd0e738df60a1","Type":"ContainerStarted","Data":"007543fb31fecd25954f62ed5af35bfc5061b8d5f7ab51f6cd4375dd52a75604"} Jul 01 16:08:37.511451 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:37.510618 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-120.ec2.internal" podStartSLOduration=3.5105956149999997 podStartE2EDuration="3.510595615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:37.510487269 +0000 UTC m=+5.562625277" watchObservedRunningTime="2026-07-01 16:08:37.510595615 +0000 UTC m=+5.562733609" Jul 01 16:08:38.025367 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:38.025325 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret\") pod \"global-pull-secret-syncer-7p2nk\" (UID: \"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1\") " pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:38.025548 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:38.025389 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs\") pod \"network-metrics-daemon-xffss\" (UID: \"92a3b32f-42e1-4747-8b1d-5a20ed0e7c02\") " pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:38.025548 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:38.025475 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:38.025548 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:38.025539 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs podName:92a3b32f-42e1-4747-8b1d-5a20ed0e7c02 nodeName:}" failed. No retries permitted until 2026-07-01 16:08:42.025519137 +0000 UTC m=+10.077657117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs") pod "network-metrics-daemon-xffss" (UID: "92a3b32f-42e1-4747-8b1d-5a20ed0e7c02") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:38.025724 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:38.025475 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:38.025724 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:38.025628 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret podName:3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1 nodeName:}" failed. No retries permitted until 2026-07-01 16:08:42.025611527 +0000 UTC m=+10.077749501 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret") pod "global-pull-secret-syncer-7p2nk" (UID: "3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:38.126207 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:38.126167 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt2v7\" (UniqueName: \"kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7\") pod \"network-check-target-b9tls\" (UID: \"f6b6e3ee-d314-4aff-8cc8-833388db7f3f\") " pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:38.126388 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:38.126333 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:08:38.126388 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:38.126353 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:08:38.126388 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:38.126365 2564 projected.go:196] Error preparing data for projected volume kube-api-access-xt2v7 for pod openshift-network-diagnostics/network-check-target-b9tls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:38.126542 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:38.126424 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7 podName:f6b6e3ee-d314-4aff-8cc8-833388db7f3f nodeName:}" failed. No retries permitted until 2026-07-01 16:08:42.126405668 +0000 UTC m=+10.178543662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xt2v7" (UniqueName: "kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7") pod "network-check-target-b9tls" (UID: "f6b6e3ee-d314-4aff-8cc8-833388db7f3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:38.354681 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:38.354601 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:38.355148 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:38.354760 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p2nk" podUID="3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1" Jul 01 16:08:38.355233 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:38.355212 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:38.355332 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:38.355308 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b9tls" podUID="f6b6e3ee-d314-4aff-8cc8-833388db7f3f" Jul 01 16:08:39.353739 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:39.353704 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:39.353940 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:39.353859 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:08:40.353675 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:40.353636 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:40.354132 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:40.353796 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b9tls" podUID="f6b6e3ee-d314-4aff-8cc8-833388db7f3f" Jul 01 16:08:40.354202 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:40.354178 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:40.354293 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:40.354271 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p2nk" podUID="3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1" Jul 01 16:08:41.353339 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:41.353247 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:41.353510 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:41.353387 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:08:42.063109 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:42.063067 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs\") pod \"network-metrics-daemon-xffss\" (UID: \"92a3b32f-42e1-4747-8b1d-5a20ed0e7c02\") " pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:42.063607 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:42.063174 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret\") pod \"global-pull-secret-syncer-7p2nk\" (UID: \"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1\") " pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:42.063607 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:42.063284 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:42.063607 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:42.063335 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret podName:3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1 nodeName:}" failed. No retries permitted until 2026-07-01 16:08:50.063322084 +0000 UTC m=+18.115460054 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret") pod "global-pull-secret-syncer-7p2nk" (UID: "3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:42.063821 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:42.063691 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:42.063821 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:42.063741 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs podName:92a3b32f-42e1-4747-8b1d-5a20ed0e7c02 nodeName:}" failed. No retries permitted until 2026-07-01 16:08:50.063726859 +0000 UTC m=+18.115864834 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs") pod "network-metrics-daemon-xffss" (UID: "92a3b32f-42e1-4747-8b1d-5a20ed0e7c02") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:42.164451 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:42.163964 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt2v7\" (UniqueName: \"kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7\") pod \"network-check-target-b9tls\" (UID: \"f6b6e3ee-d314-4aff-8cc8-833388db7f3f\") " pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:42.164451 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:42.164116 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:08:42.164451 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:42.164130 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:08:42.164451 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:42.164139 2564 projected.go:196] Error preparing data for projected volume kube-api-access-xt2v7 for pod openshift-network-diagnostics/network-check-target-b9tls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:42.164451 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:42.164181 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7 podName:f6b6e3ee-d314-4aff-8cc8-833388db7f3f nodeName:}" failed. No retries permitted until 2026-07-01 16:08:50.16416753 +0000 UTC m=+18.216305500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xt2v7" (UniqueName: "kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7") pod "network-check-target-b9tls" (UID: "f6b6e3ee-d314-4aff-8cc8-833388db7f3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:42.354465 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:42.354369 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:42.355649 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:42.355069 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p2nk" podUID="3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1" Jul 01 16:08:42.355649 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:42.355595 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:42.357716 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:42.357683 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b9tls" podUID="f6b6e3ee-d314-4aff-8cc8-833388db7f3f" Jul 01 16:08:43.354092 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:43.354057 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:43.354557 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:43.354207 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:08:44.354805 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:44.354622 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:44.354805 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:44.354753 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p2nk" podUID="3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1" Jul 01 16:08:44.355378 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:44.354995 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:44.355378 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:44.355105 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b9tls" podUID="f6b6e3ee-d314-4aff-8cc8-833388db7f3f" Jul 01 16:08:45.353483 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:45.353440 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:45.353660 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:45.353577 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:08:46.353981 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:46.353945 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:46.354311 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:46.354085 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p2nk" podUID="3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1" Jul 01 16:08:46.354311 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:46.354140 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:46.354311 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:46.354238 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b9tls" podUID="f6b6e3ee-d314-4aff-8cc8-833388db7f3f" Jul 01 16:08:47.354003 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:47.353965 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:47.354363 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:47.354111 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:08:48.353327 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:48.353292 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:48.353327 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:48.353327 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:48.353574 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:48.353413 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p2nk" podUID="3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1" Jul 01 16:08:48.353574 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:48.353514 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b9tls" podUID="f6b6e3ee-d314-4aff-8cc8-833388db7f3f" Jul 01 16:08:49.353899 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:49.353859 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:49.354422 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:49.354009 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:08:50.121920 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:50.121880 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret\") pod \"global-pull-secret-syncer-7p2nk\" (UID: \"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1\") " pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:50.122117 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:50.121937 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs\") pod \"network-metrics-daemon-xffss\" (UID: \"92a3b32f-42e1-4747-8b1d-5a20ed0e7c02\") " pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:50.122117 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:50.122060 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:50.122117 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:50.122062 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:50.122244 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:50.122126 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs podName:92a3b32f-42e1-4747-8b1d-5a20ed0e7c02 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:06.122109158 +0000 UTC m=+34.174247149 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs") pod "network-metrics-daemon-xffss" (UID: "92a3b32f-42e1-4747-8b1d-5a20ed0e7c02") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:08:50.122244 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:50.122146 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret podName:3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:06.122135571 +0000 UTC m=+34.174273541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret") pod "global-pull-secret-syncer-7p2nk" (UID: "3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:08:50.223214 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:50.223177 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt2v7\" (UniqueName: \"kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7\") pod \"network-check-target-b9tls\" (UID: \"f6b6e3ee-d314-4aff-8cc8-833388db7f3f\") " pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:50.223410 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:50.223388 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:08:50.223462 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:50.223418 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:08:50.223462 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:50.223436 2564 projected.go:196] Error preparing data for projected volume kube-api-access-xt2v7 for pod openshift-network-diagnostics/network-check-target-b9tls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:50.223539 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:50.223503 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7 podName:f6b6e3ee-d314-4aff-8cc8-833388db7f3f nodeName:}" failed. No retries permitted until 2026-07-01 16:09:06.223483649 +0000 UTC m=+34.275621634 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xt2v7" (UniqueName: "kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7") pod "network-check-target-b9tls" (UID: "f6b6e3ee-d314-4aff-8cc8-833388db7f3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:08:50.354353 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:50.354312 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:50.354829 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:50.354312 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:50.354829 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:50.354457 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p2nk" podUID="3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1" Jul 01 16:08:50.354829 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:50.354529 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b9tls" podUID="f6b6e3ee-d314-4aff-8cc8-833388db7f3f" Jul 01 16:08:51.354193 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:51.354158 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:51.354385 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:51.354300 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:08:52.354215 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:52.354161 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:52.354411 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:52.354269 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p2nk" podUID="3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1" Jul 01 16:08:52.354411 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:52.354331 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:52.354835 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:52.354456 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b9tls" podUID="f6b6e3ee-d314-4aff-8cc8-833388db7f3f" Jul 01 16:08:53.353434 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:53.353402 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:53.353627 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:53.353527 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:08:54.354577 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.354549 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:54.354974 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.354592 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:54.354974 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:54.354686 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p2nk" podUID="3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1" Jul 01 16:08:54.355145 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:54.355117 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b9tls" podUID="f6b6e3ee-d314-4aff-8cc8-833388db7f3f" Jul 01 16:08:54.547860 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.547584 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6vrq_d23ea488-6e17-4aa2-969e-f1ac3b448006/ovn-acl-logging/0.log" Jul 01 16:08:54.548246 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.548218 2564 generic.go:356] "Generic (PLEG): container finished" podID="d23ea488-6e17-4aa2-969e-f1ac3b448006" containerID="c5694c668b6247e820c690a5bb913e7de813c4f895b8088afdaa7d36aee5d721" exitCode=1 Jul 01 16:08:54.548312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.548284 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" event={"ID":"d23ea488-6e17-4aa2-969e-f1ac3b448006","Type":"ContainerStarted","Data":"922c724a2f1bd14b15852dc5bc5b6e254020e25d59ff5b9de2c9c61e0b3513fa"} Jul 01 16:08:54.548370 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.548349 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" event={"ID":"d23ea488-6e17-4aa2-969e-f1ac3b448006","Type":"ContainerDied","Data":"c5694c668b6247e820c690a5bb913e7de813c4f895b8088afdaa7d36aee5d721"} Jul 01 16:08:54.548413 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.548399 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" event={"ID":"d23ea488-6e17-4aa2-969e-f1ac3b448006","Type":"ContainerStarted","Data":"8e082217dc074562a448c7d4d32fe55c80fb89a7ffb9f41fb9471d7855188e4b"} Jul 01 16:08:54.549827 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.549802 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" event={"ID":"279e1c2d-08e3-4900-9804-48bbbc1cbbdc","Type":"ContainerStarted","Data":"5249da02c63a64c5c29d38b821c11c14767964db397d8d88641bc36894ff6de1"} Jul 01 16:08:54.551354 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.551301 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zt8cg" event={"ID":"b566220a-4b5f-4fae-99c1-288d1b902fcf","Type":"ContainerStarted","Data":"e2ba9d07cb2e3f22da71a139797b0692401de2123d1e5488d458c20478a7fb31"} Jul 01 16:08:54.552956 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.552931 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" event={"ID":"b4251a7f-62ed-4a87-b76b-f9ad941199a8","Type":"ContainerStarted","Data":"74209fe36bcaaeabafc698674355f95a5c0796029adddb6c4c5e4c7a41a9a967"} Jul 01 16:08:54.554753 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.554728 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcz47" event={"ID":"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b","Type":"ContainerStarted","Data":"c2673329a8b8e9a2030db7a6de06f763ed718292990ba9e6e6451040e3fe0da4"} Jul 01 16:08:54.556453 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.556415 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fjb2v" event={"ID":"d915b269-fc52-4ea6-aa37-4eecff380f0c","Type":"ContainerStarted","Data":"9e0b767c7f18ebd24b1f149c997dbb30b8ec0ac3e93fe64907a7837a2a9cbad1"} Jul 01 16:08:54.558015 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.557989 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9hlsb" event={"ID":"bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b","Type":"ContainerStarted","Data":"5fd1e938a2fb87be6f2cb401cb3a29f77fcf160ce32f8dea24a9a579c1c72a08"} Jul 01 16:08:54.562169 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.562122 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kxwbh" event={"ID":"a7f787d9-3e7b-490b-a193-80ac2c5b8d3d","Type":"ContainerStarted","Data":"ca82f308d2941f108a78e26f769dcc8f40d9d6677fb9c533afed74d319c91b7e"} Jul 01 16:08:54.569628 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.569583 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zt8cg" podStartSLOduration=3.814292456 podStartE2EDuration="22.569569955s" totalImagesPullingTime="18.755277499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:54.569224239 +0000 UTC m=+22.621362232" watchObservedRunningTime="2026-07-01 16:08:54.569569955 +0000 UTC m=+22.621707960" Jul 01 16:08:54.608307 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.607841 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b4dp8" podStartSLOduration=3.884832357 podStartE2EDuration="22.607753765s" totalImagesPullingTime="18.722921408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:54.606631674 +0000 UTC m=+22.658769672" watchObservedRunningTime="2026-07-01 16:08:54.607753765 +0000 UTC m=+22.659891758" Jul 01 16:08:54.622826 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.622751 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9hlsb" podStartSLOduration=3.918275684 podStartE2EDuration="22.622731461s" totalImagesPullingTime="18.704455777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:54.622596035 +0000 UTC m=+22.674734029" watchObservedRunningTime="2026-07-01 16:08:54.622731461 +0000 UTC m=+22.674869447" Jul 01 16:08:54.637473 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.637405 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kxwbh" podStartSLOduration=3.930734908 podStartE2EDuration="22.637381776s" totalImagesPullingTime="18.706646868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:54.637112608 +0000 UTC m=+22.689250602" watchObservedRunningTime="2026-07-01 16:08:54.637381776 +0000 UTC m=+22.689519770" Jul 01 16:08:54.654917 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:54.654854 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fjb2v" podStartSLOduration=4.001176791 podStartE2EDuration="22.654830414s" totalImagesPullingTime="18.653653623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:54.653735346 +0000 UTC m=+22.705873340" watchObservedRunningTime="2026-07-01 16:08:54.654830414 +0000 UTC m=+22.706968408" Jul 01 16:08:55.180245 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:55.180207 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fjb2v" Jul 01 16:08:55.180959 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:55.180935 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fjb2v" Jul 01 16:08:55.353737 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:55.353704 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:55.353903 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:55.353870 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:08:55.566192 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:55.566099 2564 generic.go:356] "Generic (PLEG): container finished" podID="dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b" containerID="c2673329a8b8e9a2030db7a6de06f763ed718292990ba9e6e6451040e3fe0da4" exitCode=0 Jul 01 16:08:55.567022 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:55.566199 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcz47" event={"ID":"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b","Type":"ContainerDied","Data":"c2673329a8b8e9a2030db7a6de06f763ed718292990ba9e6e6451040e3fe0da4"} Jul 01 16:08:55.569332 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:55.569313 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6vrq_d23ea488-6e17-4aa2-969e-f1ac3b448006/ovn-acl-logging/0.log" Jul 01 16:08:55.569831 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:55.569806 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" event={"ID":"d23ea488-6e17-4aa2-969e-f1ac3b448006","Type":"ContainerStarted","Data":"4550bb18eb3f106faf63ae7154cd1911cd030d03c70c080babad1829bd93e646"} Jul 01 16:08:55.569948 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:55.569893 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" event={"ID":"d23ea488-6e17-4aa2-969e-f1ac3b448006","Type":"ContainerStarted","Data":"3471255fdf8110c55d6480f4080c8f08d5e8257b8482c97c25cac301e1095d87"} Jul 01 16:08:55.570008 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:55.569946 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" event={"ID":"d23ea488-6e17-4aa2-969e-f1ac3b448006","Type":"ContainerStarted","Data":"9f5bfcf1e308a919b7a863baa44066a71442e3de07f7ca2a683de36f7fe19b4b"} Jul 01 16:08:55.570523 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:55.570308 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fjb2v" Jul 01 16:08:55.570726 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:55.570709 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fjb2v" Jul 01 16:08:56.050192 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:56.050149 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 16:08:56.353649 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:56.353523 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:56.353649 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:56.353525 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:56.353876 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:56.353672 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b9tls" podUID="f6b6e3ee-d314-4aff-8cc8-833388db7f3f" Jul 01 16:08:56.353876 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:56.353720 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p2nk" podUID="3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1" Jul 01 16:08:56.363191 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:56.363098 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T16:08:56.050170463Z","UUID":"f1240236-cf9e-416f-8065-3bce36c8d771","Handler":null,"Name":"","Endpoint":""} Jul 01 16:08:56.364600 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:56.364579 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 16:08:56.364745 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:56.364619 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 16:08:56.574626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:56.574585 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fp5kh" event={"ID":"29bcabe0-180d-4de5-95fc-6f62746f3847","Type":"ContainerStarted","Data":"9ec6489c24000018590063d994c32af4b9cc6f192d2bd44db52bcd1604474edd"} Jul 01 16:08:56.577080 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:56.577042 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" event={"ID":"279e1c2d-08e3-4900-9804-48bbbc1cbbdc","Type":"ContainerStarted","Data":"2daf6950cbe59bd6000f943d6b8c259bd84580bfca2731d92deb31002042f9da"} Jul 01 16:08:56.590461 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:56.590413 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fp5kh" podStartSLOduration=5.941304371 podStartE2EDuration="24.5904s" totalImagesPullingTime="18.649095629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:56.590224833 +0000 UTC m=+24.642362828" watchObservedRunningTime="2026-07-01 16:08:56.5904 +0000 UTC m=+24.642537994" Jul 01 16:08:57.354273 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:57.354237 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:57.354545 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:57.354374 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:08:57.583141 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:57.583064 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6vrq_d23ea488-6e17-4aa2-969e-f1ac3b448006/ovn-acl-logging/0.log" Jul 01 16:08:57.583639 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:57.583489 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" event={"ID":"d23ea488-6e17-4aa2-969e-f1ac3b448006","Type":"ContainerStarted","Data":"2c51f2ed24802595bb88e6118446f8b21b7f35e4336b96d223ed4968f8646db1"} Jul 01 16:08:57.585747 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:57.585720 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" event={"ID":"279e1c2d-08e3-4900-9804-48bbbc1cbbdc","Type":"ContainerStarted","Data":"778a92940472cde8139560d1b4a1101338b791efd5345e045b38898a4d0fc050"} Jul 01 16:08:57.605384 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:57.605330 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bd8xx" podStartSLOduration=4.393549331 podStartE2EDuration="25.605310428s" totalImagesPullingTime="21.211761097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:08:57.605063112 +0000 UTC m=+25.657201105" watchObservedRunningTime="2026-07-01 16:08:57.605310428 +0000 UTC m=+25.657448422" Jul 01 16:08:58.353263 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:58.353227 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:08:58.353263 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:58.353274 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:08:58.353616 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:58.353364 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p2nk" podUID="3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1" Jul 01 16:08:58.353616 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:58.353472 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b9tls" podUID="f6b6e3ee-d314-4aff-8cc8-833388db7f3f" Jul 01 16:08:59.354357 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:59.354178 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:08:59.354820 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:08:59.354437 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:08:59.592395 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:59.592310 2564 generic.go:356] "Generic (PLEG): container finished" podID="dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b" containerID="2e531125dcdeb84f2adb7f4572a31d2ef29447667b339f43b9c33a575c770480" exitCode=0 Jul 01 16:08:59.592547 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:59.592404 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcz47" event={"ID":"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b","Type":"ContainerDied","Data":"2e531125dcdeb84f2adb7f4572a31d2ef29447667b339f43b9c33a575c770480"} Jul 01 16:08:59.595963 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:59.595948 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6vrq_d23ea488-6e17-4aa2-969e-f1ac3b448006/ovn-acl-logging/0.log" Jul 01 16:08:59.596311 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:59.596290 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" event={"ID":"d23ea488-6e17-4aa2-969e-f1ac3b448006","Type":"ContainerStarted","Data":"5eb3f3052c69579b8868c96faea8a2e7d5f4495c4de4a892a4be2793a0149cec"} Jul 01 16:08:59.596543 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:59.596532 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:08:59.596698 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:59.596684 2564 scope.go:117] "RemoveContainer" containerID="c5694c668b6247e820c690a5bb913e7de813c4f895b8088afdaa7d36aee5d721" Jul 01 16:08:59.612391 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:08:59.612371 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:09:00.357161 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:00.357131 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:09:00.357692 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:00.357173 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:09:00.357692 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:00.357242 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b9tls" podUID="f6b6e3ee-d314-4aff-8cc8-833388db7f3f" Jul 01 16:09:00.357692 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:00.357376 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p2nk" podUID="3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1" Jul 01 16:09:00.602170 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:00.602106 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6vrq_d23ea488-6e17-4aa2-969e-f1ac3b448006/ovn-acl-logging/0.log" Jul 01 16:09:00.602513 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:00.602483 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" event={"ID":"d23ea488-6e17-4aa2-969e-f1ac3b448006","Type":"ContainerStarted","Data":"df98a7bb52c8f654edccacf78572259846aa6fc0e689312214afaa1a5b18fb2b"} Jul 01 16:09:00.602845 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:00.602823 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:09:00.602987 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:00.602896 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:09:00.618817 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:00.618749 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:09:00.637291 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:00.637238 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" podStartSLOduration=9.873078225 podStartE2EDuration="28.637224428s" totalImagesPullingTime="18.764146203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:00.634727072 +0000 UTC m=+28.686865067" watchObservedRunningTime="2026-07-01 16:09:00.637224428 +0000 UTC m=+28.689362420" Jul 01 16:09:01.354067 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:01.353859 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:09:01.354306 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:01.354170 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:09:01.404587 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:01.404545 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b9tls"] Jul 01 16:09:01.404968 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:01.404655 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:09:01.404968 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:01.404730 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b9tls" podUID="f6b6e3ee-d314-4aff-8cc8-833388db7f3f" Jul 01 16:09:01.407298 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:01.407275 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7p2nk"] Jul 01 16:09:01.407434 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:01.407395 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:09:01.407509 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:01.407489 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p2nk" podUID="3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1" Jul 01 16:09:01.407961 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:01.407941 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xffss"] Jul 01 16:09:01.606585 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:01.606492 2564 generic.go:356] "Generic (PLEG): container finished" podID="dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b" containerID="09ff31082592af141863fff5d28d3e7ddfea4c03c9c8991efe2117251e4befe1" exitCode=0 Jul 01 16:09:01.606757 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:01.606582 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcz47" event={"ID":"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b","Type":"ContainerDied","Data":"09ff31082592af141863fff5d28d3e7ddfea4c03c9c8991efe2117251e4befe1"} Jul 01 16:09:01.606757 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:01.606617 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:09:01.607138 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:01.607113 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:09:03.353843 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:03.353803 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:09:03.353843 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:03.353830 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:09:03.354307 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:03.353828 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:09:03.354307 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:03.353936 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b9tls" podUID="f6b6e3ee-d314-4aff-8cc8-833388db7f3f" Jul 01 16:09:03.354307 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:03.354036 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:09:03.354307 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:03.354141 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p2nk" podUID="3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1" Jul 01 16:09:03.612894 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:03.612860 2564 generic.go:356] "Generic (PLEG): container finished" podID="dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b" containerID="1e55c0a9bbbfed6cb04cf0b6f2ef4655c3e0f6c018947a20108110198d45f722" exitCode=0 Jul 01 16:09:03.613090 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:03.612906 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcz47" event={"ID":"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b","Type":"ContainerDied","Data":"1e55c0a9bbbfed6cb04cf0b6f2ef4655c3e0f6c018947a20108110198d45f722"} Jul 01 16:09:05.353871 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:05.353831 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:09:05.354301 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:05.353872 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:09:05.354301 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:05.353959 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b9tls" podUID="f6b6e3ee-d314-4aff-8cc8-833388db7f3f" Jul 01 16:09:05.354301 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:05.353991 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:09:05.354301 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:05.354067 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p2nk" podUID="3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1" Jul 01 16:09:05.354301 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:05.354121 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xffss" podUID="92a3b32f-42e1-4747-8b1d-5a20ed0e7c02" Jul 01 16:09:05.929350 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:05.929316 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjb2v_d915b269-fc52-4ea6-aa37-4eecff380f0c/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:06.139207 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:06.139167 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret\") pod \"global-pull-secret-syncer-7p2nk\" (UID: \"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1\") " pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:09:06.139402 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:06.139230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs\") pod \"network-metrics-daemon-xffss\" (UID: \"92a3b32f-42e1-4747-8b1d-5a20ed0e7c02\") " pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:09:06.139402 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:06.139278 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:06.139402 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:06.139350 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret podName:3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:38.139328241 +0000 UTC m=+66.191466212 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret") pod "global-pull-secret-syncer-7p2nk" (UID: "3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1") : object "kube-system"/"original-pull-secret" not registered Jul 01 16:09:06.139402 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:06.139352 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:06.139556 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:06.139413 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs podName:92a3b32f-42e1-4747-8b1d-5a20ed0e7c02 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:38.139394387 +0000 UTC m=+66.191532369 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs") pod "network-metrics-daemon-xffss" (UID: "92a3b32f-42e1-4747-8b1d-5a20ed0e7c02") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 16:09:06.240048 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:06.239958 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt2v7\" (UniqueName: \"kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7\") pod \"network-check-target-b9tls\" (UID: \"f6b6e3ee-d314-4aff-8cc8-833388db7f3f\") " pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:09:06.240216 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:06.240132 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 16:09:06.240216 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:06.240157 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 16:09:06.240216 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:06.240171 2564 projected.go:196] Error preparing data for projected volume kube-api-access-xt2v7 for pod openshift-network-diagnostics/network-check-target-b9tls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:06.240373 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:06.240230 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7 podName:f6b6e3ee-d314-4aff-8cc8-833388db7f3f nodeName:}" failed. No retries permitted until 2026-07-01 16:09:38.240216648 +0000 UTC m=+66.292354633 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xt2v7" (UniqueName: "kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7") pod "network-check-target-b9tls" (UID: "f6b6e3ee-d314-4aff-8cc8-833388db7f3f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 16:09:07.276906 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.276637 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-120.ec2.internal" event="NodeReady" Jul 01 16:09:07.277337 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.276986 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 16:09:07.320728 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.320698 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7crn7"] Jul 01 16:09:07.323268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.323231 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:07.324233 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.324209 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6pkqr"] Jul 01 16:09:07.325918 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.325895 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6pkqr" Jul 01 16:09:07.326212 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.325904 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ft5w7\"" Jul 01 16:09:07.326314 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.326264 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 16:09:07.326413 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.326395 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 16:09:07.328954 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.328934 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-htp2k\"" Jul 01 16:09:07.329292 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.329272 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 16:09:07.329390 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.329292 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 16:09:07.329443 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.329395 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 16:09:07.333952 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.333886 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7crn7"] Jul 01 16:09:07.336431 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.336377 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6pkqr"] Jul 01 16:09:07.353691 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.353659 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:09:07.353891 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.353672 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:09:07.353891 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.353792 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:09:07.356860 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.356833 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8sl4f\"" Jul 01 16:09:07.356997 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.356954 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 16:09:07.357268 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.357247 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 16:09:07.357375 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.357266 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v7gln\"" Jul 01 16:09:07.358278 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.358254 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 16:09:07.358385 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.358301 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 16:09:07.450049 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.450012 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31d847e5-8b59-4754-8125-5574445399b3-tmp-dir\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:07.450237 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.450064 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/509edfc7-789d-4b9e-aa59-ab1e58518e50-cert\") pod \"ingress-canary-6pkqr\" (UID: \"509edfc7-789d-4b9e-aa59-ab1e58518e50\") " pod="openshift-ingress-canary/ingress-canary-6pkqr" Jul 01 16:09:07.450237 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.450155 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db8qs\" (UniqueName: \"kubernetes.io/projected/31d847e5-8b59-4754-8125-5574445399b3-kube-api-access-db8qs\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:07.450237 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.450192 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31d847e5-8b59-4754-8125-5574445399b3-config-volume\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:07.450394 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.450316 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c54qp\" (UniqueName: \"kubernetes.io/projected/509edfc7-789d-4b9e-aa59-ab1e58518e50-kube-api-access-c54qp\") pod \"ingress-canary-6pkqr\" (UID: \"509edfc7-789d-4b9e-aa59-ab1e58518e50\") " pod="openshift-ingress-canary/ingress-canary-6pkqr" Jul 01 16:09:07.450394 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.450373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:07.551308 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.551222 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31d847e5-8b59-4754-8125-5574445399b3-tmp-dir\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:07.551308 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.551291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/509edfc7-789d-4b9e-aa59-ab1e58518e50-cert\") pod \"ingress-canary-6pkqr\" (UID: \"509edfc7-789d-4b9e-aa59-ab1e58518e50\") " pod="openshift-ingress-canary/ingress-canary-6pkqr" Jul 01 16:09:07.551513 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.551314 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db8qs\" (UniqueName: \"kubernetes.io/projected/31d847e5-8b59-4754-8125-5574445399b3-kube-api-access-db8qs\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:07.551513 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.551339 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31d847e5-8b59-4754-8125-5574445399b3-config-volume\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:07.551513 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.551374 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c54qp\" (UniqueName: \"kubernetes.io/projected/509edfc7-789d-4b9e-aa59-ab1e58518e50-kube-api-access-c54qp\") pod \"ingress-canary-6pkqr\" (UID: \"509edfc7-789d-4b9e-aa59-ab1e58518e50\") " pod="openshift-ingress-canary/ingress-canary-6pkqr" Jul 01 16:09:07.551513 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.551397 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:07.551513 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:07.551505 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:07.551725 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:07.551568 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls podName:31d847e5-8b59-4754-8125-5574445399b3 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:08.051548695 +0000 UTC m=+36.103686686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls") pod "dns-default-7crn7" (UID: "31d847e5-8b59-4754-8125-5574445399b3") : secret "dns-default-metrics-tls" not found Jul 01 16:09:07.551725 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.551636 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31d847e5-8b59-4754-8125-5574445399b3-tmp-dir\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:07.551961 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.551941 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/31d847e5-8b59-4754-8125-5574445399b3-config-volume\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:07.556437 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.556408 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/509edfc7-789d-4b9e-aa59-ab1e58518e50-cert\") pod \"ingress-canary-6pkqr\" (UID: \"509edfc7-789d-4b9e-aa59-ab1e58518e50\") " pod="openshift-ingress-canary/ingress-canary-6pkqr" Jul 01 16:09:07.560867 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.560839 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db8qs\" (UniqueName: \"kubernetes.io/projected/31d847e5-8b59-4754-8125-5574445399b3-kube-api-access-db8qs\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:07.561160 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.561136 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c54qp\" (UniqueName: \"kubernetes.io/projected/509edfc7-789d-4b9e-aa59-ab1e58518e50-kube-api-access-c54qp\") pod \"ingress-canary-6pkqr\" (UID: \"509edfc7-789d-4b9e-aa59-ab1e58518e50\") " pod="openshift-ingress-canary/ingress-canary-6pkqr" Jul 01 16:09:07.563693 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.563628 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjb2v_d915b269-fc52-4ea6-aa37-4eecff380f0c/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:07.643594 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:07.643557 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6pkqr" Jul 01 16:09:08.056255 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:08.056215 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:08.056457 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:08.056391 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:08.056519 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:08.056491 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls podName:31d847e5-8b59-4754-8125-5574445399b3 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:09.05646735 +0000 UTC m=+37.108605333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls") pod "dns-default-7crn7" (UID: "31d847e5-8b59-4754-8125-5574445399b3") : secret "dns-default-metrics-tls" not found Jul 01 16:09:08.218088 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:08.217933 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6pkqr"] Jul 01 16:09:08.220907 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:09:08.220882 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod509edfc7_789d_4b9e_aa59_ab1e58518e50.slice/crio-1afb445e75cdfa2a08c622b6740371d17366da9455350ba51d5dee44d0841cf5 WatchSource:0}: Error finding container 1afb445e75cdfa2a08c622b6740371d17366da9455350ba51d5dee44d0841cf5: Status 404 returned error can't find the container with id 1afb445e75cdfa2a08c622b6740371d17366da9455350ba51d5dee44d0841cf5 Jul 01 16:09:08.345211 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:08.345180 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjb2v_d915b269-fc52-4ea6-aa37-4eecff380f0c/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:08.628280 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:08.628198 2564 generic.go:356] "Generic (PLEG): container finished" podID="dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b" containerID="75df5364f9aca890d058ce79e37393fb9400db9b895ce0ce0a9952d1ce4b71f2" exitCode=0 Jul 01 16:09:08.628433 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:08.628273 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcz47" event={"ID":"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b","Type":"ContainerDied","Data":"75df5364f9aca890d058ce79e37393fb9400db9b895ce0ce0a9952d1ce4b71f2"} Jul 01 16:09:08.629369 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:08.629343 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6pkqr" event={"ID":"509edfc7-789d-4b9e-aa59-ab1e58518e50","Type":"ContainerStarted","Data":"1afb445e75cdfa2a08c622b6740371d17366da9455350ba51d5dee44d0841cf5"} Jul 01 16:09:09.064444 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:09.064331 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:09.064444 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:09.064432 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:09.064617 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:09.064486 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls podName:31d847e5-8b59-4754-8125-5574445399b3 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:11.064471651 +0000 UTC m=+39.116609622 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls") pod "dns-default-7crn7" (UID: "31d847e5-8b59-4754-8125-5574445399b3") : secret "dns-default-metrics-tls" not found Jul 01 16:09:09.635736 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:09.635673 2564 generic.go:356] "Generic (PLEG): container finished" podID="dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b" containerID="ff12d99866b11acdc4fdb2d1e2fe825ee9ed6daedc4f204833d110e1ecd031ee" exitCode=0 Jul 01 16:09:09.635736 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:09.635734 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcz47" event={"ID":"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b","Type":"ContainerDied","Data":"ff12d99866b11acdc4fdb2d1e2fe825ee9ed6daedc4f204833d110e1ecd031ee"} Jul 01 16:09:10.150355 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:10.150307 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjb2v_d915b269-fc52-4ea6-aa37-4eecff380f0c/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:10.204201 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:10.204167 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjb2v_d915b269-fc52-4ea6-aa37-4eecff380f0c/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:10.643131 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:10.643037 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xcz47" event={"ID":"dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b","Type":"ContainerStarted","Data":"36ad6e30a903ce11a14fd0342206da813ad6b4ee4d13c537f3bafd38ade89ab1"} Jul 01 16:09:10.669970 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:10.669910 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xcz47" podStartSLOduration=7.969709943 podStartE2EDuration="38.669889659s" totalImagesPullingTime="30.700179716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:10.667409151 +0000 UTC m=+38.719547145" watchObservedRunningTime="2026-07-01 16:09:10.669889659 +0000 UTC m=+38.722027652" Jul 01 16:09:10.792918 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:10.792881 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjb2v_d915b269-fc52-4ea6-aa37-4eecff380f0c/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:10.893684 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:10.893597 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjb2v_d915b269-fc52-4ea6-aa37-4eecff380f0c/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:11.080321 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:11.080287 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:11.080512 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:11.080415 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:11.080512 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:11.080477 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls podName:31d847e5-8b59-4754-8125-5574445399b3 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:15.080463143 +0000 UTC m=+43.132601114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls") pod "dns-default-7crn7" (UID: "31d847e5-8b59-4754-8125-5574445399b3") : secret "dns-default-metrics-tls" not found Jul 01 16:09:11.483041 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:11.483008 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjb2v_d915b269-fc52-4ea6-aa37-4eecff380f0c/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:11.560761 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:11.560732 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjb2v_d915b269-fc52-4ea6-aa37-4eecff380f0c/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:11.618681 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:11.618596 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjb2v_d915b269-fc52-4ea6-aa37-4eecff380f0c/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:11.646753 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:11.646721 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6pkqr" event={"ID":"509edfc7-789d-4b9e-aa59-ab1e58518e50","Type":"ContainerStarted","Data":"6eb419f9b7eeb5f27474b57b8a8b2c44988ed544d2fe756b3d46dbeb26b6dbe8"} Jul 01 16:09:11.666922 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:11.666872 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6pkqr" podStartSLOduration=1.906004991 podStartE2EDuration="4.666855964s" totalImagesPullingTime="2.760850973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:11.665216582 +0000 UTC m=+39.717354578" watchObservedRunningTime="2026-07-01 16:09:11.666855964 +0000 UTC m=+39.718993935" Jul 01 16:09:15.109585 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:15.109542 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:15.109981 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:15.109657 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:15.109981 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:15.109712 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls podName:31d847e5-8b59-4754-8125-5574445399b3 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:23.109696958 +0000 UTC m=+51.161834929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls") pod "dns-default-7crn7" (UID: "31d847e5-8b59-4754-8125-5574445399b3") : secret "dns-default-metrics-tls" not found Jul 01 16:09:23.166437 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:23.166389 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:23.166934 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:23.166505 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:23.166934 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:23.166587 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls podName:31d847e5-8b59-4754-8125-5574445399b3 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:39.166573659 +0000 UTC m=+67.218711630 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls") pod "dns-default-7crn7" (UID: "31d847e5-8b59-4754-8125-5574445399b3") : secret "dns-default-metrics-tls" not found Jul 01 16:09:28.060714 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:28.060672 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjb2v_d915b269-fc52-4ea6-aa37-4eecff380f0c/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:28.114384 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:28.114323 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fjb2v_d915b269-fc52-4ea6-aa37-4eecff380f0c/konnectivity-agent/0.log" limit=1024 Jul 01 16:09:32.623533 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:32.623508 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g6vrq" Jul 01 16:09:36.304002 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.303966 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-lz8wv"] Jul 01 16:09:36.306473 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.306454 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-lz8wv" Jul 01 16:09:36.309308 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.309285 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:09:36.309445 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.309285 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 01 16:09:36.310831 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.310810 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-znrk7\"" Jul 01 16:09:36.316820 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.316800 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-lz8wv"] Jul 01 16:09:36.360566 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.360533 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r5mz\" (UniqueName: \"kubernetes.io/projected/2ceb791b-b65c-4745-af66-416c7137858d-kube-api-access-4r5mz\") pod \"volume-data-source-validator-69d9f679db-lz8wv\" (UID: \"2ceb791b-b65c-4745-af66-416c7137858d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-lz8wv" Jul 01 16:09:36.419834 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.419798 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7ff457b8c9-nmq97"] Jul 01 16:09:36.421590 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.421568 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:36.429612 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.429588 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 01 16:09:36.429732 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.429645 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 16:09:36.429732 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.429667 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 01 16:09:36.429732 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.429704 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 01 16:09:36.429895 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.429868 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 01 16:09:36.429895 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.429877 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-d2j7s\"" Jul 01 16:09:36.429971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.429873 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 16:09:36.461480 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.461441 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r5mz\" (UniqueName: \"kubernetes.io/projected/2ceb791b-b65c-4745-af66-416c7137858d-kube-api-access-4r5mz\") pod \"volume-data-source-validator-69d9f679db-lz8wv\" (UID: \"2ceb791b-b65c-4745-af66-416c7137858d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-lz8wv" Jul 01 16:09:36.461654 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.461489 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-default-certificate\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:36.461654 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.461515 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:36.461654 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.461538 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-stats-auth\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:36.461654 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.461559 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c6wj\" (UniqueName: \"kubernetes.io/projected/22150373-2e93-453b-89da-c649f379b358-kube-api-access-7c6wj\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:36.461837 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.461677 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:36.549618 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.549578 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5589fb4688-lnkvr"] Jul 01 16:09:36.551446 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.551423 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.562667 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.562644 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7a13a04-b781-4af3-a839-8873b0c04557-registry-certificates\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.562790 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.562686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7a13a04-b781-4af3-a839-8873b0c04557-trusted-ca\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.562790 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.562707 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-default-certificate\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:36.562790 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.562742 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:36.562790 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.562769 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-stats-auth\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:36.562926 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.562810 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c6wj\" (UniqueName: \"kubernetes.io/projected/22150373-2e93-453b-89da-c649f379b358-kube-api-access-7c6wj\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:36.562926 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:36.562879 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 16:09:36.562992 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.562929 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg6rt\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-kube-api-access-rg6rt\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.562992 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:36.562951 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs podName:22150373-2e93-453b-89da-c649f379b358 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:37.062930978 +0000 UTC m=+65.115068960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs") pod "router-default-7ff457b8c9-nmq97" (UID: "22150373-2e93-453b-89da-c649f379b358") : secret "router-metrics-certs-default" not found Jul 01 16:09:36.563090 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.563003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7a13a04-b781-4af3-a839-8873b0c04557-installation-pull-secrets\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.563090 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.563049 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.563090 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.563078 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7a13a04-b781-4af3-a839-8873b0c04557-ca-trust-extracted\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.563221 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.563109 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-bound-sa-token\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.563221 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.563131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7a13a04-b781-4af3-a839-8873b0c04557-image-registry-private-configuration\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.563221 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.563203 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:36.563364 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:36.563347 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle podName:22150373-2e93-453b-89da-c649f379b358 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:37.063327987 +0000 UTC m=+65.115465978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle") pod "router-default-7ff457b8c9-nmq97" (UID: "22150373-2e93-453b-89da-c649f379b358") : configmap references non-existent config key: service-ca.crt Jul 01 16:09:36.566480 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.566464 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-stats-auth\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:36.566544 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.566479 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-default-certificate\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:36.578383 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:36.578354 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"registry-dockercfg-q8wwv\" is forbidden: User \"system:node:ip-10-0-136-120.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-136-120.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q8wwv\"" type="*v1.Secret" Jul 01 16:09:36.578517 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:36.578495 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-private-configuration\" is forbidden: User \"system:node:ip-10-0-136-120.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-136-120.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" type="*v1.Secret" Jul 01 16:09:36.585326 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:36.585282 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"installation-pull-secrets\" is forbidden: User \"system:node:ip-10-0-136-120.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-136-120.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" type="*v1.Secret" Jul 01 16:09:36.585694 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:36.585679 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"image-registry-tls\" is forbidden: User \"system:node:ip-10-0-136-120.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-136-120.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" type="*v1.Secret" Jul 01 16:09:36.596329 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.596304 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7ff457b8c9-nmq97"] Jul 01 16:09:36.597668 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.597648 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r5mz\" (UniqueName: \"kubernetes.io/projected/2ceb791b-b65c-4745-af66-416c7137858d-kube-api-access-4r5mz\") pod \"volume-data-source-validator-69d9f679db-lz8wv\" (UID: \"2ceb791b-b65c-4745-af66-416c7137858d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-lz8wv" Jul 01 16:09:36.615151 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.615122 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-lz8wv" Jul 01 16:09:36.625754 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.625727 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c6wj\" (UniqueName: \"kubernetes.io/projected/22150373-2e93-453b-89da-c649f379b358-kube-api-access-7c6wj\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:36.653319 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.652983 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 16:09:36.653575 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.653503 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5589fb4688-lnkvr"] Jul 01 16:09:36.663506 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.663476 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7a13a04-b781-4af3-a839-8873b0c04557-trusted-ca\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.663648 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.663516 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg6rt\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-kube-api-access-rg6rt\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.663648 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.663545 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7a13a04-b781-4af3-a839-8873b0c04557-installation-pull-secrets\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.663648 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.663575 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.663648 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.663604 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7a13a04-b781-4af3-a839-8873b0c04557-ca-trust-extracted\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.663900 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.663654 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-bound-sa-token\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.663900 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.663686 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7a13a04-b781-4af3-a839-8873b0c04557-image-registry-private-configuration\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.663900 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.663789 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7a13a04-b781-4af3-a839-8873b0c04557-registry-certificates\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.664137 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.664112 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7a13a04-b781-4af3-a839-8873b0c04557-ca-trust-extracted\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.664285 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.664266 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7a13a04-b781-4af3-a839-8873b0c04557-registry-certificates\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.664735 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.664713 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7a13a04-b781-4af3-a839-8873b0c04557-trusted-ca\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.683983 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.683953 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-bound-sa-token\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.684178 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.684160 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg6rt\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-kube-api-access-rg6rt\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:36.730128 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.730096 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-t4c2t"] Jul 01 16:09:36.732858 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.732830 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd"] Jul 01 16:09:36.733093 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.733059 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.734611 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.734592 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd" Jul 01 16:09:36.736715 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.736690 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 01 16:09:36.738016 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.737978 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 16:09:36.738016 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.737990 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 01 16:09:36.738016 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.738024 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 16:09:36.738016 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.737980 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:09:36.738353 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.738096 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fjjhf\"" Jul 01 16:09:36.738353 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.737994 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 01 16:09:36.738353 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.738033 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-stqx4\"" Jul 01 16:09:36.739475 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.739456 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 01 16:09:36.740492 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.740161 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 01 16:09:36.743642 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.743621 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 01 16:09:36.745901 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.745882 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd"] Jul 01 16:09:36.748980 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.748949 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-t4c2t"] Jul 01 16:09:36.761725 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.761699 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-lz8wv"] Jul 01 16:09:36.764288 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.764262 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nznkg\" (UniqueName: \"kubernetes.io/projected/be8e3866-367a-4db4-b049-ed6e537345a2-kube-api-access-nznkg\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.764380 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.764303 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b5997010-85fd-4486-a9e5-f5ef49c7e238-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-trfgd\" (UID: \"b5997010-85fd-4486-a9e5-f5ef49c7e238\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd" Jul 01 16:09:36.764380 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.764353 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hnhp\" (UniqueName: \"kubernetes.io/projected/b5997010-85fd-4486-a9e5-f5ef49c7e238-kube-api-access-6hnhp\") pod \"service-ca-operator-5d7b7dc95c-trfgd\" (UID: \"b5997010-85fd-4486-a9e5-f5ef49c7e238\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd" Jul 01 16:09:36.764467 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.764449 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/be8e3866-367a-4db4-b049-ed6e537345a2-snapshots\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.764512 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.764469 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be8e3866-367a-4db4-b049-ed6e537345a2-tmp\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.764512 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.764487 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5997010-85fd-4486-a9e5-f5ef49c7e238-config\") pod \"service-ca-operator-5d7b7dc95c-trfgd\" (UID: \"b5997010-85fd-4486-a9e5-f5ef49c7e238\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd" Jul 01 16:09:36.764598 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.764523 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be8e3866-367a-4db4-b049-ed6e537345a2-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.764598 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:09:36.764536 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ceb791b_b65c_4745_af66_416c7137858d.slice/crio-0ba9a48c27dcf04f5c4e68219c2e5a800b3a53ecfe894352f8d6e430ce85a3a5 WatchSource:0}: Error finding container 0ba9a48c27dcf04f5c4e68219c2e5a800b3a53ecfe894352f8d6e430ce85a3a5: Status 404 returned error can't find the container with id 0ba9a48c27dcf04f5c4e68219c2e5a800b3a53ecfe894352f8d6e430ce85a3a5 Jul 01 16:09:36.764598 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.764564 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be8e3866-367a-4db4-b049-ed6e537345a2-serving-cert\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.764700 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.764632 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be8e3866-367a-4db4-b049-ed6e537345a2-service-ca-bundle\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.804039 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.804007 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp"] Jul 01 16:09:36.806286 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.806271 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp" Jul 01 16:09:36.809214 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.809155 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 01 16:09:36.809214 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.809158 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 01 16:09:36.809419 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.809406 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-f47sl\"" Jul 01 16:09:36.818863 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.818842 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp"] Jul 01 16:09:36.865416 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.865347 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be8e3866-367a-4db4-b049-ed6e537345a2-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.865416 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.865398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be8e3866-367a-4db4-b049-ed6e537345a2-serving-cert\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.865416 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.865424 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be8e3866-367a-4db4-b049-ed6e537345a2-service-ca-bundle\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.865686 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.865627 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98c4c335-2def-44af-b1a5-933915d2bb6a-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-hpjwp\" (UID: \"98c4c335-2def-44af-b1a5-933915d2bb6a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp" Jul 01 16:09:36.865686 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.865668 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nznkg\" (UniqueName: \"kubernetes.io/projected/be8e3866-367a-4db4-b049-ed6e537345a2-kube-api-access-nznkg\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.865808 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.865703 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b5997010-85fd-4486-a9e5-f5ef49c7e238-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-trfgd\" (UID: \"b5997010-85fd-4486-a9e5-f5ef49c7e238\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd" Jul 01 16:09:36.865808 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.865729 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hnhp\" (UniqueName: \"kubernetes.io/projected/b5997010-85fd-4486-a9e5-f5ef49c7e238-kube-api-access-6hnhp\") pod \"service-ca-operator-5d7b7dc95c-trfgd\" (UID: \"b5997010-85fd-4486-a9e5-f5ef49c7e238\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd" Jul 01 16:09:36.865808 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.865788 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-hpjwp\" (UID: \"98c4c335-2def-44af-b1a5-933915d2bb6a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp" Jul 01 16:09:36.865957 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.865853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/be8e3866-367a-4db4-b049-ed6e537345a2-snapshots\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.865957 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.865878 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be8e3866-367a-4db4-b049-ed6e537345a2-tmp\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.865957 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.865902 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5997010-85fd-4486-a9e5-f5ef49c7e238-config\") pod \"service-ca-operator-5d7b7dc95c-trfgd\" (UID: \"b5997010-85fd-4486-a9e5-f5ef49c7e238\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd" Jul 01 16:09:36.866103 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.866080 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be8e3866-367a-4db4-b049-ed6e537345a2-service-ca-bundle\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.866554 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.866520 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5997010-85fd-4486-a9e5-f5ef49c7e238-config\") pod \"service-ca-operator-5d7b7dc95c-trfgd\" (UID: \"b5997010-85fd-4486-a9e5-f5ef49c7e238\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd" Jul 01 16:09:36.866554 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.866537 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be8e3866-367a-4db4-b049-ed6e537345a2-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.866554 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.866551 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be8e3866-367a-4db4-b049-ed6e537345a2-tmp\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.866737 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.866617 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/be8e3866-367a-4db4-b049-ed6e537345a2-snapshots\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.868008 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.867990 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b5997010-85fd-4486-a9e5-f5ef49c7e238-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-trfgd\" (UID: \"b5997010-85fd-4486-a9e5-f5ef49c7e238\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd" Jul 01 16:09:36.868057 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.868021 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be8e3866-367a-4db4-b049-ed6e537345a2-serving-cert\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.875110 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.875088 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nznkg\" (UniqueName: \"kubernetes.io/projected/be8e3866-367a-4db4-b049-ed6e537345a2-kube-api-access-nznkg\") pod \"insights-operator-5f67b55555-t4c2t\" (UID: \"be8e3866-367a-4db4-b049-ed6e537345a2\") " pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:36.875441 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.875422 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hnhp\" (UniqueName: \"kubernetes.io/projected/b5997010-85fd-4486-a9e5-f5ef49c7e238-kube-api-access-6hnhp\") pod \"service-ca-operator-5d7b7dc95c-trfgd\" (UID: \"b5997010-85fd-4486-a9e5-f5ef49c7e238\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd" Jul 01 16:09:36.966891 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.966859 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98c4c335-2def-44af-b1a5-933915d2bb6a-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-hpjwp\" (UID: \"98c4c335-2def-44af-b1a5-933915d2bb6a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp" Jul 01 16:09:36.967031 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.966915 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-hpjwp\" (UID: \"98c4c335-2def-44af-b1a5-933915d2bb6a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp" Jul 01 16:09:36.967071 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:36.967029 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 16:09:36.967104 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:36.967081 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert podName:98c4c335-2def-44af-b1a5-933915d2bb6a nodeName:}" failed. No retries permitted until 2026-07-01 16:09:37.467068568 +0000 UTC m=+65.519206542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-hpjwp" (UID: "98c4c335-2def-44af-b1a5-933915d2bb6a") : secret "networking-console-plugin-cert" not found Jul 01 16:09:36.967471 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:36.967452 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/98c4c335-2def-44af-b1a5-933915d2bb6a-nginx-conf\") pod \"networking-console-plugin-6cdb5968b9-hpjwp\" (UID: \"98c4c335-2def-44af-b1a5-933915d2bb6a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp" Jul 01 16:09:37.043622 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:37.043571 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-t4c2t" Jul 01 16:09:37.049859 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:37.049839 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd" Jul 01 16:09:37.067549 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:37.067522 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:37.067683 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:37.067565 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:37.067786 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:37.067755 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 16:09:37.067848 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:37.067766 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle podName:22150373-2e93-453b-89da-c649f379b358 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:38.067740482 +0000 UTC m=+66.119878456 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle") pod "router-default-7ff457b8c9-nmq97" (UID: "22150373-2e93-453b-89da-c649f379b358") : configmap references non-existent config key: service-ca.crt Jul 01 16:09:37.067848 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:37.067837 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs podName:22150373-2e93-453b-89da-c649f379b358 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:38.067819214 +0000 UTC m=+66.119957201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs") pod "router-default-7ff457b8c9-nmq97" (UID: "22150373-2e93-453b-89da-c649f379b358") : secret "router-metrics-certs-default" not found Jul 01 16:09:37.174913 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:37.174882 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-t4c2t"] Jul 01 16:09:37.178818 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:09:37.178765 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe8e3866_367a_4db4_b049_ed6e537345a2.slice/crio-980e8a89193f54cb64eebd3f52ec6c0bc1a140a95f08de2035dc6e5b34ae4082 WatchSource:0}: Error finding container 980e8a89193f54cb64eebd3f52ec6c0bc1a140a95f08de2035dc6e5b34ae4082: Status 404 returned error can't find the container with id 980e8a89193f54cb64eebd3f52ec6c0bc1a140a95f08de2035dc6e5b34ae4082 Jul 01 16:09:37.192702 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:37.192673 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd"] Jul 01 16:09:37.195204 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:09:37.195182 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5997010_85fd_4486_a9e5_f5ef49c7e238.slice/crio-396ff8b4d3a7eae4d664f93f35721d3b63f8eb77cf4759b0740d32337c289f8a WatchSource:0}: Error finding container 396ff8b4d3a7eae4d664f93f35721d3b63f8eb77cf4759b0740d32337c289f8a: Status 404 returned error can't find the container with id 396ff8b4d3a7eae4d664f93f35721d3b63f8eb77cf4759b0740d32337c289f8a Jul 01 16:09:37.471685 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:37.471650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-hpjwp\" (UID: \"98c4c335-2def-44af-b1a5-933915d2bb6a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp" Jul 01 16:09:37.472057 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:37.471818 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 16:09:37.472057 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:37.471884 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert podName:98c4c335-2def-44af-b1a5-933915d2bb6a nodeName:}" failed. No retries permitted until 2026-07-01 16:09:38.471868702 +0000 UTC m=+66.524006673 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-hpjwp" (UID: "98c4c335-2def-44af-b1a5-933915d2bb6a") : secret "networking-console-plugin-cert" not found Jul 01 16:09:37.478410 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:37.478386 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 16:09:37.483924 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:37.483908 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:09:37.483977 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:37.483926 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5589fb4688-lnkvr: secret "image-registry-tls" not found Jul 01 16:09:37.484010 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:37.483979 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls podName:a7a13a04-b781-4af3-a839-8873b0c04557 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:37.983959156 +0000 UTC m=+66.036097143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls") pod "image-registry-5589fb4688-lnkvr" (UID: "a7a13a04-b781-4af3-a839-8873b0c04557") : secret "image-registry-tls" not found Jul 01 16:09:37.629366 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:37.629335 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 16:09:37.636458 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:37.636431 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7a13a04-b781-4af3-a839-8873b0c04557-installation-pull-secrets\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:37.664664 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:37.664628 2564 secret.go:189] Couldn't get secret openshift-image-registry/image-registry-private-configuration: failed to sync secret cache: timed out waiting for the condition Jul 01 16:09:37.664839 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:37.664708 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7a13a04-b781-4af3-a839-8873b0c04557-image-registry-private-configuration podName:a7a13a04-b781-4af3-a839-8873b0c04557 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:38.164692628 +0000 UTC m=+66.216830603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "image-registry-private-configuration" (UniqueName: "kubernetes.io/secret/a7a13a04-b781-4af3-a839-8873b0c04557-image-registry-private-configuration") pod "image-registry-5589fb4688-lnkvr" (UID: "a7a13a04-b781-4af3-a839-8873b0c04557") : failed to sync secret cache: timed out waiting for the condition Jul 01 16:09:37.707183 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:37.707148 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd" event={"ID":"b5997010-85fd-4486-a9e5-f5ef49c7e238","Type":"ContainerStarted","Data":"396ff8b4d3a7eae4d664f93f35721d3b63f8eb77cf4759b0740d32337c289f8a"} Jul 01 16:09:37.708141 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:37.708120 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-t4c2t" event={"ID":"be8e3866-367a-4db4-b049-ed6e537345a2","Type":"ContainerStarted","Data":"980e8a89193f54cb64eebd3f52ec6c0bc1a140a95f08de2035dc6e5b34ae4082"} Jul 01 16:09:37.709154 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:37.709133 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-lz8wv" event={"ID":"2ceb791b-b65c-4745-af66-416c7137858d","Type":"ContainerStarted","Data":"0ba9a48c27dcf04f5c4e68219c2e5a800b3a53ecfe894352f8d6e430ce85a3a5"} Jul 01 16:09:37.714001 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:37.713983 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q8wwv\"" Jul 01 16:09:38.076685 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.076653 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 16:09:38.077337 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.077258 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:38.077337 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.077319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:38.077514 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.077362 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:38.077514 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:38.077410 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle podName:22150373-2e93-453b-89da-c649f379b358 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:40.07738392 +0000 UTC m=+68.129521893 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle") pod "router-default-7ff457b8c9-nmq97" (UID: "22150373-2e93-453b-89da-c649f379b358") : configmap references non-existent config key: service-ca.crt Jul 01 16:09:38.077514 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:38.077460 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 16:09:38.077671 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:38.077524 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs podName:22150373-2e93-453b-89da-c649f379b358 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:40.077510442 +0000 UTC m=+68.129648431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs") pod "router-default-7ff457b8c9-nmq97" (UID: "22150373-2e93-453b-89da-c649f379b358") : secret "router-metrics-certs-default" not found Jul 01 16:09:38.077671 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:38.077464 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:09:38.077671 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:38.077545 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5589fb4688-lnkvr: secret "image-registry-tls" not found Jul 01 16:09:38.077671 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:38.077584 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls podName:a7a13a04-b781-4af3-a839-8873b0c04557 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:39.077572082 +0000 UTC m=+67.129710053 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls") pod "image-registry-5589fb4688-lnkvr" (UID: "a7a13a04-b781-4af3-a839-8873b0c04557") : secret "image-registry-tls" not found Jul 01 16:09:38.178365 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.178321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs\") pod \"network-metrics-daemon-xffss\" (UID: \"92a3b32f-42e1-4747-8b1d-5a20ed0e7c02\") " pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:09:38.178540 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.178435 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret\") pod \"global-pull-secret-syncer-7p2nk\" (UID: \"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1\") " pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:09:38.178540 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.178492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7a13a04-b781-4af3-a839-8873b0c04557-image-registry-private-configuration\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:38.181399 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.181340 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7a13a04-b781-4af3-a839-8873b0c04557-image-registry-private-configuration\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:38.181541 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.181468 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 16:09:38.181653 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.181610 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 16:09:38.188971 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:38.188946 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 01 16:09:38.189075 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:38.189022 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs podName:92a3b32f-42e1-4747-8b1d-5a20ed0e7c02 nodeName:}" failed. No retries permitted until 2026-07-01 16:10:42.189000691 +0000 UTC m=+130.241138678 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs") pod "network-metrics-daemon-xffss" (UID: "92a3b32f-42e1-4747-8b1d-5a20ed0e7c02") : secret "metrics-daemon-secret" not found Jul 01 16:09:38.191418 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.191394 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1-original-pull-secret\") pod \"global-pull-secret-syncer-7p2nk\" (UID: \"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1\") " pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:09:38.279283 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.279249 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p2nk" Jul 01 16:09:38.279604 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.279574 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xt2v7\" (UniqueName: \"kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7\") pod \"network-check-target-b9tls\" (UID: \"f6b6e3ee-d314-4aff-8cc8-833388db7f3f\") " pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:09:38.282855 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.282627 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 16:09:38.293017 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.292812 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 16:09:38.303223 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.303114 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xt2v7\" (UniqueName: \"kubernetes.io/projected/f6b6e3ee-d314-4aff-8cc8-833388db7f3f-kube-api-access-xt2v7\") pod \"network-check-target-b9tls\" (UID: \"f6b6e3ee-d314-4aff-8cc8-833388db7f3f\") " pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:09:38.430619 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.430592 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7p2nk"] Jul 01 16:09:38.433455 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:09:38.433430 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d7cf2e2_7fcb_410a_a8b6_7045a9147cc1.slice/crio-56dbc77e70e1beb5b86103100a24abbc49840344423e0beb64eb0a8802d44858 WatchSource:0}: Error finding container 56dbc77e70e1beb5b86103100a24abbc49840344423e0beb64eb0a8802d44858: Status 404 returned error can't find the container with id 56dbc77e70e1beb5b86103100a24abbc49840344423e0beb64eb0a8802d44858 Jul 01 16:09:38.481204 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.481166 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-hpjwp\" (UID: \"98c4c335-2def-44af-b1a5-933915d2bb6a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp" Jul 01 16:09:38.481741 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:38.481318 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 16:09:38.481741 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:38.481387 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert podName:98c4c335-2def-44af-b1a5-933915d2bb6a nodeName:}" failed. No retries permitted until 2026-07-01 16:09:40.481369695 +0000 UTC m=+68.533507667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-hpjwp" (UID: "98c4c335-2def-44af-b1a5-933915d2bb6a") : secret "networking-console-plugin-cert" not found Jul 01 16:09:38.570048 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.570017 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8sl4f\"" Jul 01 16:09:38.577047 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.577021 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:09:38.714062 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.714018 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-lz8wv" event={"ID":"2ceb791b-b65c-4745-af66-416c7137858d","Type":"ContainerStarted","Data":"3741c222eed224e1eec3d6d01ef9a4607cd71267d141380e630b4a4f50ac6686"} Jul 01 16:09:38.715308 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.715269 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7p2nk" event={"ID":"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1","Type":"ContainerStarted","Data":"56dbc77e70e1beb5b86103100a24abbc49840344423e0beb64eb0a8802d44858"} Jul 01 16:09:38.722259 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.722227 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b9tls"] Jul 01 16:09:38.726274 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:09:38.726243 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6b6e3ee_d314_4aff_8cc8_833388db7f3f.slice/crio-8503535826e7c4cba20c67d58994bb39535d3790bc147a04cf730398c695fb39 WatchSource:0}: Error finding container 8503535826e7c4cba20c67d58994bb39535d3790bc147a04cf730398c695fb39: Status 404 returned error can't find the container with id 8503535826e7c4cba20c67d58994bb39535d3790bc147a04cf730398c695fb39 Jul 01 16:09:38.730067 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:38.730021 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-lz8wv" podStartSLOduration=1.3095771809999999 podStartE2EDuration="2.730005809s" totalImagesPullingTime="1.420428628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:38.729660776 +0000 UTC m=+66.781798773" watchObservedRunningTime="2026-07-01 16:09:38.730005809 +0000 UTC m=+66.782143802" Jul 01 16:09:39.086103 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:39.086065 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:39.086295 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:39.086207 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:09:39.086295 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:39.086222 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5589fb4688-lnkvr: secret "image-registry-tls" not found Jul 01 16:09:39.086295 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:39.086285 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls podName:a7a13a04-b781-4af3-a839-8873b0c04557 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:41.086264303 +0000 UTC m=+69.138402296 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls") pod "image-registry-5589fb4688-lnkvr" (UID: "a7a13a04-b781-4af3-a839-8873b0c04557") : secret "image-registry-tls" not found Jul 01 16:09:39.187338 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:39.187299 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:09:39.187526 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:39.187473 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 16:09:39.187594 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:39.187545 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls podName:31d847e5-8b59-4754-8125-5574445399b3 nodeName:}" failed. No retries permitted until 2026-07-01 16:10:11.187522777 +0000 UTC m=+99.239660754 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls") pod "dns-default-7crn7" (UID: "31d847e5-8b59-4754-8125-5574445399b3") : secret "dns-default-metrics-tls" not found Jul 01 16:09:39.720554 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:39.720513 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b9tls" event={"ID":"f6b6e3ee-d314-4aff-8cc8-833388db7f3f","Type":"ContainerStarted","Data":"8503535826e7c4cba20c67d58994bb39535d3790bc147a04cf730398c695fb39"} Jul 01 16:09:40.096525 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:40.096407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:40.096698 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:40.096578 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 16:09:40.096698 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:40.096592 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:40.096698 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:40.096652 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs podName:22150373-2e93-453b-89da-c649f379b358 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:44.096632036 +0000 UTC m=+72.148770011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs") pod "router-default-7ff457b8c9-nmq97" (UID: "22150373-2e93-453b-89da-c649f379b358") : secret "router-metrics-certs-default" not found Jul 01 16:09:40.096698 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:40.096697 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle podName:22150373-2e93-453b-89da-c649f379b358 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:44.096685247 +0000 UTC m=+72.148823220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle") pod "router-default-7ff457b8c9-nmq97" (UID: "22150373-2e93-453b-89da-c649f379b358") : configmap references non-existent config key: service-ca.crt Jul 01 16:09:40.499167 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:40.499121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-hpjwp\" (UID: \"98c4c335-2def-44af-b1a5-933915d2bb6a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp" Jul 01 16:09:40.499358 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:40.499295 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 16:09:40.499433 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:40.499385 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert podName:98c4c335-2def-44af-b1a5-933915d2bb6a nodeName:}" failed. No retries permitted until 2026-07-01 16:09:44.499362536 +0000 UTC m=+72.551500529 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-hpjwp" (UID: "98c4c335-2def-44af-b1a5-933915d2bb6a") : secret "networking-console-plugin-cert" not found Jul 01 16:09:41.106309 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:41.106217 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:41.106757 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:41.106402 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:09:41.106757 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:41.106418 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5589fb4688-lnkvr: secret "image-registry-tls" not found Jul 01 16:09:41.106757 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:41.106476 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls podName:a7a13a04-b781-4af3-a839-8873b0c04557 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:45.106457818 +0000 UTC m=+73.158595792 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls") pod "image-registry-5589fb4688-lnkvr" (UID: "a7a13a04-b781-4af3-a839-8873b0c04557") : secret "image-registry-tls" not found Jul 01 16:09:41.729252 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:41.728686 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-t4c2t" event={"ID":"be8e3866-367a-4db4-b049-ed6e537345a2","Type":"ContainerStarted","Data":"a898145457fc61e9493bdfa003bd4e0776a5488cca708c823ecff7f015ec51f9"} Jul 01 16:09:41.730355 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:41.730324 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd" event={"ID":"b5997010-85fd-4486-a9e5-f5ef49c7e238","Type":"ContainerStarted","Data":"45491e30945c724840e05f75fe7ba90343cf42deaa70e5d736b23f98a890a6df"} Jul 01 16:09:41.747929 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:41.747420 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-t4c2t" podStartSLOduration=2.302209395 podStartE2EDuration="5.747397602s" totalImagesPullingTime="3.445188207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:41.746145581 +0000 UTC m=+69.798283575" watchObservedRunningTime="2026-07-01 16:09:41.747397602 +0000 UTC m=+69.799535598" Jul 01 16:09:41.766368 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:41.765610 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd" podStartSLOduration=2.328737778 podStartE2EDuration="5.765588107s" totalImagesPullingTime="3.436850329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:41.764705676 +0000 UTC m=+69.816843670" watchObservedRunningTime="2026-07-01 16:09:41.765588107 +0000 UTC m=+69.817726101" Jul 01 16:09:41.972249 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:41.972175 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-266ns"] Jul 01 16:09:41.989400 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:41.988720 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-266ns"] Jul 01 16:09:41.989400 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:41.988879 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:41.991931 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:41.991866 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 16:09:41.991931 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:41.991919 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 16:09:41.992139 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:41.991867 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dd5dp\"" Jul 01 16:09:42.018114 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:42.018067 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76c6eb34-fa15-4a8b-aa39-96f04c90038f-crio-socket\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:42.018297 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:42.018136 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzlvw\" (UniqueName: \"kubernetes.io/projected/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-api-access-vzlvw\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:42.018297 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:42.018181 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:42.018297 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:42.018221 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76c6eb34-fa15-4a8b-aa39-96f04c90038f-data-volume\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:42.018297 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:42.018291 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:42.119235 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:42.119184 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:42.119669 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:42.119321 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76c6eb34-fa15-4a8b-aa39-96f04c90038f-crio-socket\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:42.119669 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:42.119350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzlvw\" (UniqueName: \"kubernetes.io/projected/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-api-access-vzlvw\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:42.119669 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:42.119372 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:42.119669 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:42.119382 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:42.119669 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:42.119414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76c6eb34-fa15-4a8b-aa39-96f04c90038f-data-volume\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:42.119669 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:42.119445 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls podName:76c6eb34-fa15-4a8b-aa39-96f04c90038f nodeName:}" failed. No retries permitted until 2026-07-01 16:09:42.619424254 +0000 UTC m=+70.671562248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-266ns" (UID: "76c6eb34-fa15-4a8b-aa39-96f04c90038f") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:42.119669 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:42.119489 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/76c6eb34-fa15-4a8b-aa39-96f04c90038f-crio-socket\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:42.119669 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:42.119515 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:09:42.119669 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:42.119586 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm podName:76c6eb34-fa15-4a8b-aa39-96f04c90038f nodeName:}" failed. No retries permitted until 2026-07-01 16:09:42.619566099 +0000 UTC m=+70.671704076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-266ns" (UID: "76c6eb34-fa15-4a8b-aa39-96f04c90038f") : configmap "kube-rbac-proxy" not found Jul 01 16:09:42.120129 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:42.119741 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/76c6eb34-fa15-4a8b-aa39-96f04c90038f-data-volume\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:42.131438 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:42.131405 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzlvw\" (UniqueName: \"kubernetes.io/projected/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-api-access-vzlvw\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:42.623698 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:42.623661 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:42.623924 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:42.623739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:42.623924 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:42.623817 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:09:42.623924 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:42.623904 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:42.624086 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:42.623913 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm podName:76c6eb34-fa15-4a8b-aa39-96f04c90038f nodeName:}" failed. No retries permitted until 2026-07-01 16:09:43.623891729 +0000 UTC m=+71.676029714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-266ns" (UID: "76c6eb34-fa15-4a8b-aa39-96f04c90038f") : configmap "kube-rbac-proxy" not found Jul 01 16:09:42.624086 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:42.623988 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls podName:76c6eb34-fa15-4a8b-aa39-96f04c90038f nodeName:}" failed. No retries permitted until 2026-07-01 16:09:43.623970368 +0000 UTC m=+71.676108345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-266ns" (UID: "76c6eb34-fa15-4a8b-aa39-96f04c90038f") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:43.633142 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:43.633112 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:43.633487 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:43.633209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:43.633487 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:43.633295 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:09:43.633487 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:43.633304 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:43.633487 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:43.633340 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm podName:76c6eb34-fa15-4a8b-aa39-96f04c90038f nodeName:}" failed. No retries permitted until 2026-07-01 16:09:45.633327529 +0000 UTC m=+73.685465500 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-266ns" (UID: "76c6eb34-fa15-4a8b-aa39-96f04c90038f") : configmap "kube-rbac-proxy" not found Jul 01 16:09:43.633487 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:43.633373 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls podName:76c6eb34-fa15-4a8b-aa39-96f04c90038f nodeName:}" failed. No retries permitted until 2026-07-01 16:09:45.633354691 +0000 UTC m=+73.685492664 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-266ns" (UID: "76c6eb34-fa15-4a8b-aa39-96f04c90038f") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:43.738920 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:43.738876 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7p2nk" event={"ID":"3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1","Type":"ContainerStarted","Data":"9889916b328e1ce76800cf73c5810080d3d9de962a7b0867c52a65ca6768bb12"} Jul 01 16:09:43.740420 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:43.740391 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b9tls" event={"ID":"f6b6e3ee-d314-4aff-8cc8-833388db7f3f","Type":"ContainerStarted","Data":"ef7ac7c777fee8ac5dee2d4d34fdb9ab079659e0ad6bffe132393160210469bf"} Jul 01 16:09:43.740576 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:43.740517 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:09:43.754925 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:43.754877 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7p2nk" podStartSLOduration=66.652042111 podStartE2EDuration="1m11.754859648s" totalImagesPullingTime="5.102817537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:43.754398694 +0000 UTC m=+71.806536687" watchObservedRunningTime="2026-07-01 16:09:43.754859648 +0000 UTC m=+71.806997641" Jul 01 16:09:43.771426 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:43.771374 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b9tls" podStartSLOduration=66.960240371 podStartE2EDuration="1m11.771356205s" totalImagesPullingTime="4.811115834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:43.770733035 +0000 UTC m=+71.822871029" watchObservedRunningTime="2026-07-01 16:09:43.771356205 +0000 UTC m=+71.823494198" Jul 01 16:09:43.948141 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:43.948066 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9hlsb_bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b/dns-node-resolver/0.log" Jul 01 16:09:44.137955 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:44.137918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:44.138099 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:44.137972 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:44.138099 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:44.138084 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle podName:22150373-2e93-453b-89da-c649f379b358 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:52.138066382 +0000 UTC m=+80.190204352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle") pod "router-default-7ff457b8c9-nmq97" (UID: "22150373-2e93-453b-89da-c649f379b358") : configmap references non-existent config key: service-ca.crt Jul 01 16:09:44.138213 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:44.138124 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 16:09:44.138213 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:44.138177 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs podName:22150373-2e93-453b-89da-c649f379b358 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:52.138164385 +0000 UTC m=+80.190302355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs") pod "router-default-7ff457b8c9-nmq97" (UID: "22150373-2e93-453b-89da-c649f379b358") : secret "router-metrics-certs-default" not found Jul 01 16:09:44.541738 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:44.541696 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-hpjwp\" (UID: \"98c4c335-2def-44af-b1a5-933915d2bb6a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp" Jul 01 16:09:44.541944 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:44.541879 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 16:09:44.541993 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:44.541947 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert podName:98c4c335-2def-44af-b1a5-933915d2bb6a nodeName:}" failed. No retries permitted until 2026-07-01 16:09:52.541931209 +0000 UTC m=+80.594069180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-hpjwp" (UID: "98c4c335-2def-44af-b1a5-933915d2bb6a") : secret "networking-console-plugin-cert" not found Jul 01 16:09:44.945489 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:44.945401 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kxwbh_a7f787d9-3e7b-490b-a193-80ac2c5b8d3d/node-ca/0.log" Jul 01 16:09:45.145871 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:45.145832 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:45.146021 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:45.145980 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 16:09:45.146021 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:45.145996 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5589fb4688-lnkvr: secret "image-registry-tls" not found Jul 01 16:09:45.146090 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:45.146052 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls podName:a7a13a04-b781-4af3-a839-8873b0c04557 nodeName:}" failed. No retries permitted until 2026-07-01 16:09:53.146036099 +0000 UTC m=+81.198174069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls") pod "image-registry-5589fb4688-lnkvr" (UID: "a7a13a04-b781-4af3-a839-8873b0c04557") : secret "image-registry-tls" not found Jul 01 16:09:45.544041 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:45.544001 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6pkqr_509edfc7-789d-4b9e-aa59-ab1e58518e50/serve-healthcheck-canary/0.log" Jul 01 16:09:45.650488 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:45.650450 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:45.650650 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:45.650576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:45.650650 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:45.650604 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:45.650716 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:45.650673 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:09:45.650716 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:45.650679 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls podName:76c6eb34-fa15-4a8b-aa39-96f04c90038f nodeName:}" failed. No retries permitted until 2026-07-01 16:09:49.650658812 +0000 UTC m=+77.702796801 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-266ns" (UID: "76c6eb34-fa15-4a8b-aa39-96f04c90038f") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:45.650716 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:45.650709 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm podName:76c6eb34-fa15-4a8b-aa39-96f04c90038f nodeName:}" failed. No retries permitted until 2026-07-01 16:09:49.650697746 +0000 UTC m=+77.702835734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-266ns" (UID: "76c6eb34-fa15-4a8b-aa39-96f04c90038f") : configmap "kube-rbac-proxy" not found Jul 01 16:09:49.682391 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:49.682359 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:49.682800 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:49.682414 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:49.682800 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:49.682503 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 16:09:49.682800 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:49.682571 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm podName:76c6eb34-fa15-4a8b-aa39-96f04c90038f nodeName:}" failed. No retries permitted until 2026-07-01 16:09:57.682555067 +0000 UTC m=+85.734693038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-266ns" (UID: "76c6eb34-fa15-4a8b-aa39-96f04c90038f") : configmap "kube-rbac-proxy" not found Jul 01 16:09:49.682800 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:49.682512 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:49.682800 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:49.682631 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls podName:76c6eb34-fa15-4a8b-aa39-96f04c90038f nodeName:}" failed. No retries permitted until 2026-07-01 16:09:57.682620175 +0000 UTC m=+85.734758145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-266ns" (UID: "76c6eb34-fa15-4a8b-aa39-96f04c90038f") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:52.202463 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:52.202419 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:52.202952 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:52.202482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:09:52.202952 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:52.202606 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle podName:22150373-2e93-453b-89da-c649f379b358 nodeName:}" failed. No retries permitted until 2026-07-01 16:10:08.202587572 +0000 UTC m=+96.254725545 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle") pod "router-default-7ff457b8c9-nmq97" (UID: "22150373-2e93-453b-89da-c649f379b358") : configmap references non-existent config key: service-ca.crt Jul 01 16:09:52.202952 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:52.202603 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 16:09:52.202952 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:52.202644 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs podName:22150373-2e93-453b-89da-c649f379b358 nodeName:}" failed. No retries permitted until 2026-07-01 16:10:08.202636524 +0000 UTC m=+96.254774495 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs") pod "router-default-7ff457b8c9-nmq97" (UID: "22150373-2e93-453b-89da-c649f379b358") : secret "router-metrics-certs-default" not found Jul 01 16:09:52.606438 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:52.606346 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-hpjwp\" (UID: \"98c4c335-2def-44af-b1a5-933915d2bb6a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp" Jul 01 16:09:52.606585 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:52.606501 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 01 16:09:52.606585 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:52.606566 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert podName:98c4c335-2def-44af-b1a5-933915d2bb6a nodeName:}" failed. No retries permitted until 2026-07-01 16:10:08.606551574 +0000 UTC m=+96.658689548 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert") pod "networking-console-plugin-6cdb5968b9-hpjwp" (UID: "98c4c335-2def-44af-b1a5-933915d2bb6a") : secret "networking-console-plugin-cert" not found Jul 01 16:09:53.211237 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:53.211200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:53.213543 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:53.213521 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls\") pod \"image-registry-5589fb4688-lnkvr\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:53.359915 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:53.359874 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:53.491871 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:53.491847 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5589fb4688-lnkvr"] Jul 01 16:09:53.493792 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:09:53.493734 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a13a04_b781_4af3_a839_8873b0c04557.slice/crio-919e8edba8b9c5b7f479a6ce4066d467ef5b46b6202ca79dfa4f3c154a38aeda WatchSource:0}: Error finding container 919e8edba8b9c5b7f479a6ce4066d467ef5b46b6202ca79dfa4f3c154a38aeda: Status 404 returned error can't find the container with id 919e8edba8b9c5b7f479a6ce4066d467ef5b46b6202ca79dfa4f3c154a38aeda Jul 01 16:09:53.772608 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:53.772518 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" event={"ID":"a7a13a04-b781-4af3-a839-8873b0c04557","Type":"ContainerStarted","Data":"882fe1675b6d5fbbd3f9a359622ef6c8ae2a03a454de4d79beba3e47befbb08f"} Jul 01 16:09:53.772608 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:53.772577 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" event={"ID":"a7a13a04-b781-4af3-a839-8873b0c04557","Type":"ContainerStarted","Data":"919e8edba8b9c5b7f479a6ce4066d467ef5b46b6202ca79dfa4f3c154a38aeda"} Jul 01 16:09:53.772808 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:53.772616 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:09:53.796979 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:53.796931 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" podStartSLOduration=17.796914909 podStartE2EDuration="17.796914909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:09:53.796206694 +0000 UTC m=+81.848344687" watchObservedRunningTime="2026-07-01 16:09:53.796914909 +0000 UTC m=+81.849052902" Jul 01 16:09:57.749974 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:57.749927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:57.750446 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:57.750005 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:09:57.750446 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:57.750103 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 16:09:57.750446 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:09:57.750159 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls podName:76c6eb34-fa15-4a8b-aa39-96f04c90038f nodeName:}" failed. No retries permitted until 2026-07-01 16:10:13.750145322 +0000 UTC m=+101.802283293 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-266ns" (UID: "76c6eb34-fa15-4a8b-aa39-96f04c90038f") : secret "insights-runtime-extractor-tls" not found Jul 01 16:09:57.750558 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:09:57.750457 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/76c6eb34-fa15-4a8b-aa39-96f04c90038f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:10:02.993573 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:02.993537 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5589fb4688-lnkvr"] Jul 01 16:10:03.043965 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.043929 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cdf76f5c8-6m788"] Jul 01 16:10:03.049495 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.049469 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.060992 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.060965 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cdf76f5c8-6m788"] Jul 01 16:10:03.195187 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.195154 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/15cb0df7-84bf-4127-b479-f49b18c3a9e3-registry-certificates\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.195187 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.195193 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5ckz\" (UniqueName: \"kubernetes.io/projected/15cb0df7-84bf-4127-b479-f49b18c3a9e3-kube-api-access-w5ckz\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.195430 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.195227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/15cb0df7-84bf-4127-b479-f49b18c3a9e3-ca-trust-extracted\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.195430 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.195288 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/15cb0df7-84bf-4127-b479-f49b18c3a9e3-trusted-ca\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.195430 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.195373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/15cb0df7-84bf-4127-b479-f49b18c3a9e3-image-registry-private-configuration\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.195552 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.195442 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/15cb0df7-84bf-4127-b479-f49b18c3a9e3-bound-sa-token\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.195552 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.195465 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/15cb0df7-84bf-4127-b479-f49b18c3a9e3-registry-tls\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.195552 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.195487 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/15cb0df7-84bf-4127-b479-f49b18c3a9e3-installation-pull-secrets\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.296620 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.296532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/15cb0df7-84bf-4127-b479-f49b18c3a9e3-image-registry-private-configuration\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.296620 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.296589 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/15cb0df7-84bf-4127-b479-f49b18c3a9e3-bound-sa-token\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.296863 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.296710 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/15cb0df7-84bf-4127-b479-f49b18c3a9e3-registry-tls\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.296863 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.296752 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/15cb0df7-84bf-4127-b479-f49b18c3a9e3-installation-pull-secrets\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.296863 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.296856 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/15cb0df7-84bf-4127-b479-f49b18c3a9e3-registry-certificates\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.296994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.296895 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5ckz\" (UniqueName: \"kubernetes.io/projected/15cb0df7-84bf-4127-b479-f49b18c3a9e3-kube-api-access-w5ckz\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.296994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.296956 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/15cb0df7-84bf-4127-b479-f49b18c3a9e3-ca-trust-extracted\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.297088 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.297002 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/15cb0df7-84bf-4127-b479-f49b18c3a9e3-trusted-ca\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.297845 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.297814 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/15cb0df7-84bf-4127-b479-f49b18c3a9e3-registry-certificates\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.298086 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.298065 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/15cb0df7-84bf-4127-b479-f49b18c3a9e3-trusted-ca\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.298142 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.298122 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/15cb0df7-84bf-4127-b479-f49b18c3a9e3-ca-trust-extracted\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.299206 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.299186 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/15cb0df7-84bf-4127-b479-f49b18c3a9e3-image-registry-private-configuration\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.299308 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.299214 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/15cb0df7-84bf-4127-b479-f49b18c3a9e3-installation-pull-secrets\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.299308 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.299186 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/15cb0df7-84bf-4127-b479-f49b18c3a9e3-registry-tls\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.307190 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.307164 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/15cb0df7-84bf-4127-b479-f49b18c3a9e3-bound-sa-token\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.307326 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.307307 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5ckz\" (UniqueName: \"kubernetes.io/projected/15cb0df7-84bf-4127-b479-f49b18c3a9e3-kube-api-access-w5ckz\") pod \"image-registry-6cdf76f5c8-6m788\" (UID: \"15cb0df7-84bf-4127-b479-f49b18c3a9e3\") " pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.357554 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.357514 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.488445 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.488416 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cdf76f5c8-6m788"] Jul 01 16:10:03.491434 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:10:03.491406 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15cb0df7_84bf_4127_b479_f49b18c3a9e3.slice/crio-0453de8e9889f1f057b12a869285c2d684f57342c72bfe727648bb4f7da98e96 WatchSource:0}: Error finding container 0453de8e9889f1f057b12a869285c2d684f57342c72bfe727648bb4f7da98e96: Status 404 returned error can't find the container with id 0453de8e9889f1f057b12a869285c2d684f57342c72bfe727648bb4f7da98e96 Jul 01 16:10:03.803392 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.803314 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" event={"ID":"15cb0df7-84bf-4127-b479-f49b18c3a9e3","Type":"ContainerStarted","Data":"0b40ad081186d83815126c42f912aa0b52bea59277fd871c11c5e1f1e5b500ea"} Jul 01 16:10:03.803392 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.803365 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" event={"ID":"15cb0df7-84bf-4127-b479-f49b18c3a9e3","Type":"ContainerStarted","Data":"0453de8e9889f1f057b12a869285c2d684f57342c72bfe727648bb4f7da98e96"} Jul 01 16:10:03.803572 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.803450 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:03.825924 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:03.825869 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" podStartSLOduration=0.825835821 podStartE2EDuration="825.835821ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:03.825114098 +0000 UTC m=+91.877252091" watchObservedRunningTime="2026-07-01 16:10:03.825835821 +0000 UTC m=+91.877973814" Jul 01 16:10:08.237748 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:08.237711 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:10:08.237748 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:08.237763 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:10:08.238381 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:08.238360 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22150373-2e93-453b-89da-c649f379b358-service-ca-bundle\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:10:08.240038 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:08.240021 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22150373-2e93-453b-89da-c649f379b358-metrics-certs\") pod \"router-default-7ff457b8c9-nmq97\" (UID: \"22150373-2e93-453b-89da-c649f379b358\") " pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:10:08.529582 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:08.529489 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:10:08.641519 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:08.641483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-hpjwp\" (UID: \"98c4c335-2def-44af-b1a5-933915d2bb6a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp" Jul 01 16:10:08.643870 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:08.643845 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98c4c335-2def-44af-b1a5-933915d2bb6a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cdb5968b9-hpjwp\" (UID: \"98c4c335-2def-44af-b1a5-933915d2bb6a\") " pod="openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp" Jul 01 16:10:08.661900 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:08.661874 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7ff457b8c9-nmq97"] Jul 01 16:10:08.664616 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:10:08.664592 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22150373_2e93_453b_89da_c649f379b358.slice/crio-e0def95324f1f6fe73940b69d014c848186a3f76c7e0dd48b6ed1d6b1b6e17d0 WatchSource:0}: Error finding container e0def95324f1f6fe73940b69d014c848186a3f76c7e0dd48b6ed1d6b1b6e17d0: Status 404 returned error can't find the container with id e0def95324f1f6fe73940b69d014c848186a3f76c7e0dd48b6ed1d6b1b6e17d0 Jul 01 16:10:08.823476 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:08.823392 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7ff457b8c9-nmq97" event={"ID":"22150373-2e93-453b-89da-c649f379b358","Type":"ContainerStarted","Data":"8509518286c38a96003189227dd461571836faac7e6bb3cb599c2bcd8795aa8e"} Jul 01 16:10:08.823476 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:08.823439 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7ff457b8c9-nmq97" event={"ID":"22150373-2e93-453b-89da-c649f379b358","Type":"ContainerStarted","Data":"e0def95324f1f6fe73940b69d014c848186a3f76c7e0dd48b6ed1d6b1b6e17d0"} Jul 01 16:10:08.844024 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:08.843978 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7ff457b8c9-nmq97" podStartSLOduration=32.843963523 podStartE2EDuration="32.843963523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:08.843885863 +0000 UTC m=+96.896023868" watchObservedRunningTime="2026-07-01 16:10:08.843963523 +0000 UTC m=+96.896101515" Jul 01 16:10:08.914303 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:08.914266 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp" Jul 01 16:10:09.037385 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:09.037361 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp"] Jul 01 16:10:09.039556 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:10:09.039531 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c4c335_2def_44af_b1a5_933915d2bb6a.slice/crio-3fd4526d39aafbd1b2225fa4d1a3f57a4b591474f922ac68d029aca7cc936dc3 WatchSource:0}: Error finding container 3fd4526d39aafbd1b2225fa4d1a3f57a4b591474f922ac68d029aca7cc936dc3: Status 404 returned error can't find the container with id 3fd4526d39aafbd1b2225fa4d1a3f57a4b591474f922ac68d029aca7cc936dc3 Jul 01 16:10:09.530325 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:09.530285 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:10:09.532856 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:09.532831 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:10:09.827890 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:09.827804 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp" event={"ID":"98c4c335-2def-44af-b1a5-933915d2bb6a","Type":"ContainerStarted","Data":"3fd4526d39aafbd1b2225fa4d1a3f57a4b591474f922ac68d029aca7cc936dc3"} Jul 01 16:10:09.828044 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:09.828005 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:10:09.829309 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:09.829290 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7ff457b8c9-nmq97" Jul 01 16:10:10.832501 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:10.832462 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp" event={"ID":"98c4c335-2def-44af-b1a5-933915d2bb6a","Type":"ContainerStarted","Data":"37c7c37ae3d5d235824dc800ef85126a27b14600ce2c0b4c2b89d4fae83a26cf"} Jul 01 16:10:10.850576 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:10.850519 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cdb5968b9-hpjwp" podStartSLOduration=33.607541407 podStartE2EDuration="34.850502775s" totalImagesPullingTime="1.242961368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:10.850250019 +0000 UTC m=+98.902388027" watchObservedRunningTime="2026-07-01 16:10:10.850502775 +0000 UTC m=+98.902640792" Jul 01 16:10:11.262258 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:11.262223 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:10:11.264500 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:11.264475 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/31d847e5-8b59-4754-8125-5574445399b3-metrics-tls\") pod \"dns-default-7crn7\" (UID: \"31d847e5-8b59-4754-8125-5574445399b3\") " pod="openshift-dns/dns-default-7crn7" Jul 01 16:10:11.540008 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:11.539926 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ft5w7\"" Jul 01 16:10:11.547412 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:11.547392 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7crn7" Jul 01 16:10:11.705240 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:11.705164 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7crn7"] Jul 01 16:10:11.707947 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:10:11.707909 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31d847e5_8b59_4754_8125_5574445399b3.slice/crio-d85f577f44c941d3b1bfa7ae1163631724e9cd2dc38583bce6e29aed962ba520 WatchSource:0}: Error finding container d85f577f44c941d3b1bfa7ae1163631724e9cd2dc38583bce6e29aed962ba520: Status 404 returned error can't find the container with id d85f577f44c941d3b1bfa7ae1163631724e9cd2dc38583bce6e29aed962ba520 Jul 01 16:10:11.838383 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:11.838294 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7crn7" event={"ID":"31d847e5-8b59-4754-8125-5574445399b3","Type":"ContainerStarted","Data":"d85f577f44c941d3b1bfa7ae1163631724e9cd2dc38583bce6e29aed962ba520"} Jul 01 16:10:13.000947 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:13.000909 2564 patch_prober.go:28] interesting pod/image-registry-5589fb4688-lnkvr container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 01 16:10:13.001335 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:13.001002 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" podUID="a7a13a04-b781-4af3-a839-8873b0c04557" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 16:10:13.785177 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:13.785133 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:10:13.787375 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:13.787347 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/76c6eb34-fa15-4a8b-aa39-96f04c90038f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-266ns\" (UID: \"76c6eb34-fa15-4a8b-aa39-96f04c90038f\") " pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:10:13.802394 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:13.802365 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-266ns" Jul 01 16:10:13.847008 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:13.846976 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7crn7" event={"ID":"31d847e5-8b59-4754-8125-5574445399b3","Type":"ContainerStarted","Data":"3ed10470308a91ca91589e2eb6e40b23cdc41b365057c89b512ef8f8da1935e2"} Jul 01 16:10:13.847008 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:13.847027 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7crn7" event={"ID":"31d847e5-8b59-4754-8125-5574445399b3","Type":"ContainerStarted","Data":"21266d03120d8dec2344d73c6cbf4c2538a8f7072489b127a0449d611568b776"} Jul 01 16:10:13.847261 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:13.847062 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7crn7" Jul 01 16:10:13.869971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:13.869914 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7crn7" podStartSLOduration=65.316635193 podStartE2EDuration="1m6.86989091s" totalImagesPullingTime="1.553255717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:13.869645969 +0000 UTC m=+101.921783972" watchObservedRunningTime="2026-07-01 16:10:13.86989091 +0000 UTC m=+101.922028905" Jul 01 16:10:13.932628 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:13.932583 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-266ns"] Jul 01 16:10:13.934726 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:10:13.934699 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c6eb34_fa15_4a8b_aa39_96f04c90038f.slice/crio-af0684ca2bef9438459a735395dd526e22e05b58e45acdd4adf9ccb4879a30ed WatchSource:0}: Error finding container af0684ca2bef9438459a735395dd526e22e05b58e45acdd4adf9ccb4879a30ed: Status 404 returned error can't find the container with id af0684ca2bef9438459a735395dd526e22e05b58e45acdd4adf9ccb4879a30ed Jul 01 16:10:14.749220 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:14.749188 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b9tls" Jul 01 16:10:14.858213 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:14.857852 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-266ns" event={"ID":"76c6eb34-fa15-4a8b-aa39-96f04c90038f","Type":"ContainerStarted","Data":"af0684ca2bef9438459a735395dd526e22e05b58e45acdd4adf9ccb4879a30ed"} Jul 01 16:10:15.663729 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.663695 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-lhtqw"] Jul 01 16:10:15.692541 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.692512 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-lhtqw"] Jul 01 16:10:15.692685 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.692635 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" Jul 01 16:10:15.699372 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.699137 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 01 16:10:15.699372 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.699210 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 16:10:15.701039 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.701014 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 16:10:15.701188 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.701017 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 01 16:10:15.701188 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.701017 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 16:10:15.701326 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.701229 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-9dzm7\"" Jul 01 16:10:15.800696 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.800663 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90b6d87b-e09d-49bc-86c8-29b65db74e9a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-lhtqw\" (UID: \"90b6d87b-e09d-49bc-86c8-29b65db74e9a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" Jul 01 16:10:15.801188 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.800718 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90b6d87b-e09d-49bc-86c8-29b65db74e9a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-lhtqw\" (UID: \"90b6d87b-e09d-49bc-86c8-29b65db74e9a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" Jul 01 16:10:15.801188 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.800745 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/90b6d87b-e09d-49bc-86c8-29b65db74e9a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-lhtqw\" (UID: \"90b6d87b-e09d-49bc-86c8-29b65db74e9a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" Jul 01 16:10:15.801188 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.800850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh7sx\" (UniqueName: \"kubernetes.io/projected/90b6d87b-e09d-49bc-86c8-29b65db74e9a-kube-api-access-lh7sx\") pod \"prometheus-operator-7b7d896497-lhtqw\" (UID: \"90b6d87b-e09d-49bc-86c8-29b65db74e9a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" Jul 01 16:10:15.901417 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.901378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90b6d87b-e09d-49bc-86c8-29b65db74e9a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-lhtqw\" (UID: \"90b6d87b-e09d-49bc-86c8-29b65db74e9a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" Jul 01 16:10:15.901598 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.901424 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/90b6d87b-e09d-49bc-86c8-29b65db74e9a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-lhtqw\" (UID: \"90b6d87b-e09d-49bc-86c8-29b65db74e9a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" Jul 01 16:10:15.901598 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.901456 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh7sx\" (UniqueName: \"kubernetes.io/projected/90b6d87b-e09d-49bc-86c8-29b65db74e9a-kube-api-access-lh7sx\") pod \"prometheus-operator-7b7d896497-lhtqw\" (UID: \"90b6d87b-e09d-49bc-86c8-29b65db74e9a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" Jul 01 16:10:15.901598 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.901545 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90b6d87b-e09d-49bc-86c8-29b65db74e9a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-lhtqw\" (UID: \"90b6d87b-e09d-49bc-86c8-29b65db74e9a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" Jul 01 16:10:15.902164 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.902138 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90b6d87b-e09d-49bc-86c8-29b65db74e9a-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-lhtqw\" (UID: \"90b6d87b-e09d-49bc-86c8-29b65db74e9a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" Jul 01 16:10:15.904091 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.904065 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/90b6d87b-e09d-49bc-86c8-29b65db74e9a-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-lhtqw\" (UID: \"90b6d87b-e09d-49bc-86c8-29b65db74e9a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" Jul 01 16:10:15.904193 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.904117 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90b6d87b-e09d-49bc-86c8-29b65db74e9a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-lhtqw\" (UID: \"90b6d87b-e09d-49bc-86c8-29b65db74e9a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" Jul 01 16:10:15.911447 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:15.911419 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh7sx\" (UniqueName: \"kubernetes.io/projected/90b6d87b-e09d-49bc-86c8-29b65db74e9a-kube-api-access-lh7sx\") pod \"prometheus-operator-7b7d896497-lhtqw\" (UID: \"90b6d87b-e09d-49bc-86c8-29b65db74e9a\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" Jul 01 16:10:16.003374 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:16.003340 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" Jul 01 16:10:18.427256 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:18.427230 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-lhtqw"] Jul 01 16:10:18.429624 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:10:18.429596 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b6d87b_e09d_49bc_86c8_29b65db74e9a.slice/crio-5210fe454f34e75973af7a8e395af7f5a4cbe1567f003c9f82f9106acf0c34bd WatchSource:0}: Error finding container 5210fe454f34e75973af7a8e395af7f5a4cbe1567f003c9f82f9106acf0c34bd: Status 404 returned error can't find the container with id 5210fe454f34e75973af7a8e395af7f5a4cbe1567f003c9f82f9106acf0c34bd Jul 01 16:10:18.872407 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:18.872313 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-266ns" event={"ID":"76c6eb34-fa15-4a8b-aa39-96f04c90038f","Type":"ContainerStarted","Data":"5ebdc0aa6072e7468929683c914fcc7bfdb8374b77d39487568956131183a119"} Jul 01 16:10:18.873384 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:18.873364 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" event={"ID":"90b6d87b-e09d-49bc-86c8-29b65db74e9a","Type":"ContainerStarted","Data":"5210fe454f34e75973af7a8e395af7f5a4cbe1567f003c9f82f9106acf0c34bd"} Jul 01 16:10:20.882504 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:20.882468 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-266ns" event={"ID":"76c6eb34-fa15-4a8b-aa39-96f04c90038f","Type":"ContainerStarted","Data":"15e95dd6e21eb94a09ce6ef3a8ac0376041041363ce6d6a3f8aeb925b0b9e48c"} Jul 01 16:10:20.884441 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:20.884412 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" event={"ID":"90b6d87b-e09d-49bc-86c8-29b65db74e9a","Type":"ContainerStarted","Data":"03f09cb5bfbc5f17400a5b7bd7d9df97d0e4cc7fcb9276eeafe9dddacb8d8558"} Jul 01 16:10:20.884612 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:20.884459 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" event={"ID":"90b6d87b-e09d-49bc-86c8-29b65db74e9a","Type":"ContainerStarted","Data":"affcc946db119ca780a6d821a051f0a6898da63cd53d95f08e14106c75e168ab"} Jul 01 16:10:20.906575 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:20.906522 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-lhtqw" podStartSLOduration=4.567626614 podStartE2EDuration="5.906508327s" totalImagesPullingTime="1.338881713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:20.904661691 +0000 UTC m=+108.956799721" watchObservedRunningTime="2026-07-01 16:10:20.906508327 +0000 UTC m=+108.958646298" Jul 01 16:10:22.894130 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:22.894094 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-266ns" event={"ID":"76c6eb34-fa15-4a8b-aa39-96f04c90038f","Type":"ContainerStarted","Data":"d95be737d21741858e226c774d240211e345b6079b7a9db765b2d41d7d04e937"} Jul 01 16:10:22.917111 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:22.917054 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-266ns" podStartSLOduration=33.617402477 podStartE2EDuration="41.917038843s" totalImagesPullingTime="8.299636366s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:09:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:22.915068123 +0000 UTC m=+110.967206116" watchObservedRunningTime="2026-07-01 16:10:22.917038843 +0000 UTC m=+110.969176835" Jul 01 16:10:22.998533 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:22.998499 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:10:23.068841 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.068814 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4spbl"] Jul 01 16:10:23.071906 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.071885 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.074989 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.074967 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 16:10:23.075102 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.074967 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 16:10:23.075498 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.075481 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 16:10:23.075636 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.075621 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lgms9\"" Jul 01 16:10:23.265052 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.265017 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-tls\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.265256 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.265077 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cef7446-496a-40c6-96ce-967f98a48273-metrics-client-ca\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.265256 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.265138 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-accelerators-collector-config\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.265355 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.265252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cef7446-496a-40c6-96ce-967f98a48273-sys\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.265355 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.265283 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0cef7446-496a-40c6-96ce-967f98a48273-root\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.265355 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.265303 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-wtmp\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.265355 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.265320 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.265355 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.265338 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxw45\" (UniqueName: \"kubernetes.io/projected/0cef7446-496a-40c6-96ce-967f98a48273-kube-api-access-zxw45\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.265520 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.265357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-textfile\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.366331 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.366301 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cef7446-496a-40c6-96ce-967f98a48273-sys\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.366331 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.366333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0cef7446-496a-40c6-96ce-967f98a48273-root\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.366563 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.366351 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-wtmp\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.366563 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.366366 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.366563 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.366387 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxw45\" (UniqueName: \"kubernetes.io/projected/0cef7446-496a-40c6-96ce-967f98a48273-kube-api-access-zxw45\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.366563 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.366409 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cef7446-496a-40c6-96ce-967f98a48273-sys\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.366563 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.366420 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0cef7446-496a-40c6-96ce-967f98a48273-root\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.366563 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.366412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-textfile\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.366563 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.366472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-tls\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.366563 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.366513 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-wtmp\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.366563 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.366520 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cef7446-496a-40c6-96ce-967f98a48273-metrics-client-ca\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.366563 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.366565 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-accelerators-collector-config\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.366948 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:10:23.366662 2564 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 16:10:23.366948 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:10:23.366749 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-tls podName:0cef7446-496a-40c6-96ce-967f98a48273 nodeName:}" failed. No retries permitted until 2026-07-01 16:10:23.866726988 +0000 UTC m=+111.918864977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-tls") pod "node-exporter-4spbl" (UID: "0cef7446-496a-40c6-96ce-967f98a48273") : secret "node-exporter-tls" not found Jul 01 16:10:23.366948 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.366747 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-textfile\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.367079 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.367063 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cef7446-496a-40c6-96ce-967f98a48273-metrics-client-ca\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.367170 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.367144 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-accelerators-collector-config\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.368843 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.368824 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.377179 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.377159 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxw45\" (UniqueName: \"kubernetes.io/projected/0cef7446-496a-40c6-96ce-967f98a48273-kube-api-access-zxw45\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.860837 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.860807 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7crn7" Jul 01 16:10:23.870654 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.870626 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-tls\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.872902 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.872876 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0cef7446-496a-40c6-96ce-967f98a48273-node-exporter-tls\") pod \"node-exporter-4spbl\" (UID: \"0cef7446-496a-40c6-96ce-967f98a48273\") " pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.980947 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:23.980919 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4spbl" Jul 01 16:10:23.992237 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:10:23.992205 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cef7446_496a_40c6_96ce_967f98a48273.slice/crio-2c62d7d5292080d8d21db370f7158f5133ca0c6fd460e5b24eeff96f900aa0ba WatchSource:0}: Error finding container 2c62d7d5292080d8d21db370f7158f5133ca0c6fd460e5b24eeff96f900aa0ba: Status 404 returned error can't find the container with id 2c62d7d5292080d8d21db370f7158f5133ca0c6fd460e5b24eeff96f900aa0ba Jul 01 16:10:24.191674 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.191596 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:10:24.195356 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.195338 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.201225 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.201177 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 16:10:24.201394 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.201273 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 16:10:24.201394 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.201283 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 16:10:24.201632 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.201615 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 16:10:24.202080 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.202048 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 16:10:24.202205 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.202140 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9mdz5\"" Jul 01 16:10:24.202205 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.202163 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 16:10:24.202597 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.202249 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 16:10:24.203006 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.202988 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 16:10:24.203092 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.203034 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 16:10:24.213515 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.213484 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:10:24.274943 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.274907 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.274943 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.274941 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.275169 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.274961 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02157b73-35d5-4f16-86ba-53c91f0327dd-config-out\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.275169 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.274976 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02157b73-35d5-4f16-86ba-53c91f0327dd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.275169 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.275087 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.275169 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.275115 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.275169 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.275143 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02157b73-35d5-4f16-86ba-53c91f0327dd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.275169 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.275162 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02157b73-35d5-4f16-86ba-53c91f0327dd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.275388 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.275179 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-config-volume\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.275388 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.275201 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b25s2\" (UniqueName: \"kubernetes.io/projected/02157b73-35d5-4f16-86ba-53c91f0327dd-kube-api-access-b25s2\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.275388 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.275220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-web-config\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.275388 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.275238 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.275388 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.275270 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02157b73-35d5-4f16-86ba-53c91f0327dd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.376248 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.376210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.376398 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.376263 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.376398 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.376290 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02157b73-35d5-4f16-86ba-53c91f0327dd-config-out\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.376398 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.376305 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02157b73-35d5-4f16-86ba-53c91f0327dd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.376574 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.376397 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.376574 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.376449 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.376574 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.376491 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02157b73-35d5-4f16-86ba-53c91f0327dd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.376574 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.376507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02157b73-35d5-4f16-86ba-53c91f0327dd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.376574 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.376525 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-config-volume\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.376574 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.376550 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b25s2\" (UniqueName: \"kubernetes.io/projected/02157b73-35d5-4f16-86ba-53c91f0327dd-kube-api-access-b25s2\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.376902 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.376583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-web-config\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.376902 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.376623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.376902 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.376654 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02157b73-35d5-4f16-86ba-53c91f0327dd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.377389 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.377361 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02157b73-35d5-4f16-86ba-53c91f0327dd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.377682 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.377652 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02157b73-35d5-4f16-86ba-53c91f0327dd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.378192 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.378026 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02157b73-35d5-4f16-86ba-53c91f0327dd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.380076 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.379424 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.380076 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.380030 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.380218 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.380106 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.380559 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.380534 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.380741 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.380718 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.380832 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.380728 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02157b73-35d5-4f16-86ba-53c91f0327dd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.380832 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.380753 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-web-config\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.380976 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.380957 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02157b73-35d5-4f16-86ba-53c91f0327dd-config-out\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.381371 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.381352 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-config-volume\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.385590 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.385571 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b25s2\" (UniqueName: \"kubernetes.io/projected/02157b73-35d5-4f16-86ba-53c91f0327dd-kube-api-access-b25s2\") pod \"alertmanager-main-0\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.505795 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.505748 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:10:24.673403 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.673379 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:10:24.676410 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:10:24.676384 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02157b73_35d5_4f16_86ba_53c91f0327dd.slice/crio-779e574b6315a770a55c939b3e0b8738c7597ef4b01bd424b6b2ef89b91dcddc WatchSource:0}: Error finding container 779e574b6315a770a55c939b3e0b8738c7597ef4b01bd424b6b2ef89b91dcddc: Status 404 returned error can't find the container with id 779e574b6315a770a55c939b3e0b8738c7597ef4b01bd424b6b2ef89b91dcddc Jul 01 16:10:24.812658 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.812583 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cdf76f5c8-6m788" Jul 01 16:10:24.904933 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.904897 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4spbl" event={"ID":"0cef7446-496a-40c6-96ce-967f98a48273","Type":"ContainerStarted","Data":"2c62d7d5292080d8d21db370f7158f5133ca0c6fd460e5b24eeff96f900aa0ba"} Jul 01 16:10:24.906173 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:24.906146 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02157b73-35d5-4f16-86ba-53c91f0327dd","Type":"ContainerStarted","Data":"779e574b6315a770a55c939b3e0b8738c7597ef4b01bd424b6b2ef89b91dcddc"} Jul 01 16:10:25.912596 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:25.912520 2564 generic.go:356] "Generic (PLEG): container finished" podID="0cef7446-496a-40c6-96ce-967f98a48273" containerID="78033922f7424ec4eb98071970f6eba7800a680d9935d904a32dc9b100827929" exitCode=0 Jul 01 16:10:25.912596 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:25.912564 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4spbl" event={"ID":"0cef7446-496a-40c6-96ce-967f98a48273","Type":"ContainerDied","Data":"78033922f7424ec4eb98071970f6eba7800a680d9935d904a32dc9b100827929"} Jul 01 16:10:26.917838 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:26.917736 2564 generic.go:356] "Generic (PLEG): container finished" podID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerID="9d583aae7f3b8bc2b5f5b98c3957c7b531f1680fee6758160563c46971c3a57f" exitCode=0 Jul 01 16:10:26.917838 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:26.917824 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02157b73-35d5-4f16-86ba-53c91f0327dd","Type":"ContainerDied","Data":"9d583aae7f3b8bc2b5f5b98c3957c7b531f1680fee6758160563c46971c3a57f"} Jul 01 16:10:26.920035 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:26.920009 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4spbl" event={"ID":"0cef7446-496a-40c6-96ce-967f98a48273","Type":"ContainerStarted","Data":"e93a1f5c7e5debd2e762dc1d8902af1f8c7d625898052ea5e3fb8abe309f8946"} Jul 01 16:10:26.920121 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:26.920062 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4spbl" event={"ID":"0cef7446-496a-40c6-96ce-967f98a48273","Type":"ContainerStarted","Data":"02b3cd4a1ea87695ca8286504eaef55ab09d6392f43e5b3cb3ff79b2eeb320c4"} Jul 01 16:10:26.965077 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:26.965026 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4spbl" podStartSLOduration=2.916544025 podStartE2EDuration="3.965009896s" totalImagesPullingTime="986.634344ms" totalInitContainerRuntime="61.831527ms" isStatefulPod=true podCreationTimestamp="2026-07-01 16:10:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:26.964520625 +0000 UTC m=+115.016658619" watchObservedRunningTime="2026-07-01 16:10:26.965009896 +0000 UTC m=+115.017147889" Jul 01 16:10:27.388354 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.388324 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq"] Jul 01 16:10:27.391513 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.391497 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.394514 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.394494 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 01 16:10:27.395870 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.395841 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 01 16:10:27.395968 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.395889 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bj8pqunt1ia5v\"" Jul 01 16:10:27.396023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.396005 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mr5kq\"" Jul 01 16:10:27.396083 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.396016 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 01 16:10:27.396143 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.396087 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 16:10:27.402278 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.402256 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq"] Jul 01 16:10:27.404292 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.404268 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/577db653-dd63-4cb2-9754-681662bb5291-metrics-server-audit-profiles\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.404384 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.404317 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/577db653-dd63-4cb2-9754-681662bb5291-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.404384 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.404340 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/577db653-dd63-4cb2-9754-681662bb5291-secret-metrics-server-client-certs\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.404384 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.404357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/577db653-dd63-4cb2-9754-681662bb5291-secret-metrics-server-tls\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.404384 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.404373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwbmb\" (UniqueName: \"kubernetes.io/projected/577db653-dd63-4cb2-9754-681662bb5291-kube-api-access-gwbmb\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.404543 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.404392 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/577db653-dd63-4cb2-9754-681662bb5291-client-ca-bundle\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.404543 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.404419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/577db653-dd63-4cb2-9754-681662bb5291-audit-log\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.505525 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.505482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/577db653-dd63-4cb2-9754-681662bb5291-metrics-server-audit-profiles\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.505525 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.505532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/577db653-dd63-4cb2-9754-681662bb5291-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.505767 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.505552 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/577db653-dd63-4cb2-9754-681662bb5291-secret-metrics-server-client-certs\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.505767 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.505569 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/577db653-dd63-4cb2-9754-681662bb5291-secret-metrics-server-tls\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.505767 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.505593 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwbmb\" (UniqueName: \"kubernetes.io/projected/577db653-dd63-4cb2-9754-681662bb5291-kube-api-access-gwbmb\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.505767 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.505622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/577db653-dd63-4cb2-9754-681662bb5291-client-ca-bundle\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.505767 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.505653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/577db653-dd63-4cb2-9754-681662bb5291-audit-log\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.506141 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.506117 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/577db653-dd63-4cb2-9754-681662bb5291-audit-log\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.506449 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.506402 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/577db653-dd63-4cb2-9754-681662bb5291-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.506610 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.506592 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/577db653-dd63-4cb2-9754-681662bb5291-metrics-server-audit-profiles\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.508097 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.508073 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/577db653-dd63-4cb2-9754-681662bb5291-secret-metrics-server-tls\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.508280 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.508263 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/577db653-dd63-4cb2-9754-681662bb5291-secret-metrics-server-client-certs\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.508430 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.508409 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/577db653-dd63-4cb2-9754-681662bb5291-client-ca-bundle\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.513366 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.513348 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwbmb\" (UniqueName: \"kubernetes.io/projected/577db653-dd63-4cb2-9754-681662bb5291-kube-api-access-gwbmb\") pod \"metrics-server-7fb8f9cf44-6ftqq\" (UID: \"577db653-dd63-4cb2-9754-681662bb5291\") " pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.700374 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.700291 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:27.863604 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.863564 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq"] Jul 01 16:10:27.865750 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:10:27.865709 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577db653_dd63_4cb2_9754_681662bb5291.slice/crio-ec2fd49718f4217511613e9f93274aac3cc6737c0bf00a8825da7b62c3bdfd3d WatchSource:0}: Error finding container ec2fd49718f4217511613e9f93274aac3cc6737c0bf00a8825da7b62c3bdfd3d: Status 404 returned error can't find the container with id ec2fd49718f4217511613e9f93274aac3cc6737c0bf00a8825da7b62c3bdfd3d Jul 01 16:10:27.924371 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:27.924333 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" event={"ID":"577db653-dd63-4cb2-9754-681662bb5291","Type":"ContainerStarted","Data":"ec2fd49718f4217511613e9f93274aac3cc6737c0bf00a8825da7b62c3bdfd3d"} Jul 01 16:10:28.013181 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.013134 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" podUID="a7a13a04-b781-4af3-a839-8873b0c04557" containerName="registry" containerID="cri-o://882fe1675b6d5fbbd3f9a359622ef6c8ae2a03a454de4d79beba3e47befbb08f" gracePeriod=30 Jul 01 16:10:28.259687 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.259660 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:10:28.312535 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.312449 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7a13a04-b781-4af3-a839-8873b0c04557-ca-trust-extracted\") pod \"a7a13a04-b781-4af3-a839-8873b0c04557\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " Jul 01 16:10:28.312535 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.312498 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rg6rt\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-kube-api-access-rg6rt\") pod \"a7a13a04-b781-4af3-a839-8873b0c04557\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " Jul 01 16:10:28.312535 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.312526 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7a13a04-b781-4af3-a839-8873b0c04557-image-registry-private-configuration\") pod \"a7a13a04-b781-4af3-a839-8873b0c04557\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " Jul 01 16:10:28.312820 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.312570 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls\") pod \"a7a13a04-b781-4af3-a839-8873b0c04557\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " Jul 01 16:10:28.312820 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.312597 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7a13a04-b781-4af3-a839-8873b0c04557-trusted-ca\") pod \"a7a13a04-b781-4af3-a839-8873b0c04557\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " Jul 01 16:10:28.312820 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.312724 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7a13a04-b781-4af3-a839-8873b0c04557-registry-certificates\") pod \"a7a13a04-b781-4af3-a839-8873b0c04557\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " Jul 01 16:10:28.312820 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.312743 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-bound-sa-token\") pod \"a7a13a04-b781-4af3-a839-8873b0c04557\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " Jul 01 16:10:28.312820 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.312799 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7a13a04-b781-4af3-a839-8873b0c04557-installation-pull-secrets\") pod \"a7a13a04-b781-4af3-a839-8873b0c04557\" (UID: \"a7a13a04-b781-4af3-a839-8873b0c04557\") " Jul 01 16:10:28.313732 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.313383 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7a13a04-b781-4af3-a839-8873b0c04557-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a7a13a04-b781-4af3-a839-8873b0c04557" (UID: "a7a13a04-b781-4af3-a839-8873b0c04557"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:10:28.314183 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.314133 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7a13a04-b781-4af3-a839-8873b0c04557-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a7a13a04-b781-4af3-a839-8873b0c04557" (UID: "a7a13a04-b781-4af3-a839-8873b0c04557"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:10:28.315862 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.315826 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-kube-api-access-rg6rt" (OuterVolumeSpecName: "kube-api-access-rg6rt") pod "a7a13a04-b781-4af3-a839-8873b0c04557" (UID: "a7a13a04-b781-4af3-a839-8873b0c04557"). InnerVolumeSpecName "kube-api-access-rg6rt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:10:28.315862 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.315853 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7a13a04-b781-4af3-a839-8873b0c04557-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a7a13a04-b781-4af3-a839-8873b0c04557" (UID: "a7a13a04-b781-4af3-a839-8873b0c04557"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:10:28.316202 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.315995 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7a13a04-b781-4af3-a839-8873b0c04557-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a7a13a04-b781-4af3-a839-8873b0c04557" (UID: "a7a13a04-b781-4af3-a839-8873b0c04557"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:10:28.316202 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.316052 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a7a13a04-b781-4af3-a839-8873b0c04557" (UID: "a7a13a04-b781-4af3-a839-8873b0c04557"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:10:28.316309 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.316200 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a7a13a04-b781-4af3-a839-8873b0c04557" (UID: "a7a13a04-b781-4af3-a839-8873b0c04557"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:10:28.324442 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.324409 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7a13a04-b781-4af3-a839-8873b0c04557-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a7a13a04-b781-4af3-a839-8873b0c04557" (UID: "a7a13a04-b781-4af3-a839-8873b0c04557"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:10:28.413549 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.413510 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7a13a04-b781-4af3-a839-8873b0c04557-registry-certificates\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:10:28.413549 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.413538 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-bound-sa-token\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:10:28.413549 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.413547 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7a13a04-b781-4af3-a839-8873b0c04557-installation-pull-secrets\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:10:28.413549 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.413555 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7a13a04-b781-4af3-a839-8873b0c04557-ca-trust-extracted\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:10:28.413955 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.413564 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg6rt\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-kube-api-access-rg6rt\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:10:28.413955 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.413573 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7a13a04-b781-4af3-a839-8873b0c04557-image-registry-private-configuration\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:10:28.413955 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.413582 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7a13a04-b781-4af3-a839-8873b0c04557-registry-tls\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:10:28.413955 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.413589 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7a13a04-b781-4af3-a839-8873b0c04557-trusted-ca\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:10:28.930067 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.930029 2564 generic.go:356] "Generic (PLEG): container finished" podID="a7a13a04-b781-4af3-a839-8873b0c04557" containerID="882fe1675b6d5fbbd3f9a359622ef6c8ae2a03a454de4d79beba3e47befbb08f" exitCode=0 Jul 01 16:10:28.930508 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.930098 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" Jul 01 16:10:28.930796 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.930097 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" event={"ID":"a7a13a04-b781-4af3-a839-8873b0c04557","Type":"ContainerDied","Data":"882fe1675b6d5fbbd3f9a359622ef6c8ae2a03a454de4d79beba3e47befbb08f"} Jul 01 16:10:28.930796 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.930676 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5589fb4688-lnkvr" event={"ID":"a7a13a04-b781-4af3-a839-8873b0c04557","Type":"ContainerDied","Data":"919e8edba8b9c5b7f479a6ce4066d467ef5b46b6202ca79dfa4f3c154a38aeda"} Jul 01 16:10:28.931542 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.931492 2564 scope.go:117] "RemoveContainer" containerID="882fe1675b6d5fbbd3f9a359622ef6c8ae2a03a454de4d79beba3e47befbb08f" Jul 01 16:10:28.951688 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.951655 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5589fb4688-lnkvr"] Jul 01 16:10:28.955091 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:28.955067 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5589fb4688-lnkvr"] Jul 01 16:10:29.265620 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.265601 2564 scope.go:117] "RemoveContainer" containerID="882fe1675b6d5fbbd3f9a359622ef6c8ae2a03a454de4d79beba3e47befbb08f" Jul 01 16:10:29.265947 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:10:29.265926 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"882fe1675b6d5fbbd3f9a359622ef6c8ae2a03a454de4d79beba3e47befbb08f\": container with ID starting with 882fe1675b6d5fbbd3f9a359622ef6c8ae2a03a454de4d79beba3e47befbb08f not found: ID does not exist" containerID="882fe1675b6d5fbbd3f9a359622ef6c8ae2a03a454de4d79beba3e47befbb08f" Jul 01 16:10:29.266013 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.265958 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"882fe1675b6d5fbbd3f9a359622ef6c8ae2a03a454de4d79beba3e47befbb08f"} err="failed to get container status \"882fe1675b6d5fbbd3f9a359622ef6c8ae2a03a454de4d79beba3e47befbb08f\": rpc error: code = NotFound desc = could not find container \"882fe1675b6d5fbbd3f9a359622ef6c8ae2a03a454de4d79beba3e47befbb08f\": container with ID starting with 882fe1675b6d5fbbd3f9a359622ef6c8ae2a03a454de4d79beba3e47befbb08f not found: ID does not exist" Jul 01 16:10:29.312113 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.311960 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:10:29.314040 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.312339 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7a13a04-b781-4af3-a839-8873b0c04557" containerName="registry" Jul 01 16:10:29.314040 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.312360 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7a13a04-b781-4af3-a839-8873b0c04557" containerName="registry" Jul 01 16:10:29.314040 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.312442 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7a13a04-b781-4af3-a839-8873b0c04557" containerName="registry" Jul 01 16:10:29.316424 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.316397 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.320351 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.319793 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 16:10:29.320351 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.319973 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 16:10:29.320351 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.320307 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 16:10:29.320593 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.320458 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 16:10:29.320593 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.320486 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 16:10:29.320593 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.320494 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 16:10:29.320761 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.320745 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vxqvd\"" Jul 01 16:10:29.321587 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.321336 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 16:10:29.321587 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.321348 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 16:10:29.321587 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.321381 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 16:10:29.321587 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.321422 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 16:10:29.321587 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.321541 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 16:10:29.321587 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.321542 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-em07j1thnk76h\"" Jul 01 16:10:29.321587 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.321570 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 16:10:29.322064 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.321916 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 16:10:29.324070 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.324052 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 16:10:29.334708 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.334674 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:10:29.424869 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.424830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425049 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.424877 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425049 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.424915 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425049 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.424946 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425049 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.424980 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425049 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.425007 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425049 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.425040 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425307 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.425067 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425307 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.425133 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425307 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.425199 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425307 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.425240 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-config\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425461 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.425313 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37a25bbf-aed8-47c8-8169-b09decf8995c-config-out\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425461 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.425348 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425461 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.425373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw4l9\" (UniqueName: \"kubernetes.io/projected/37a25bbf-aed8-47c8-8169-b09decf8995c-kube-api-access-pw4l9\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425461 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.425436 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37a25bbf-aed8-47c8-8169-b09decf8995c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425612 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.425467 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425612 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.425539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425612 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.425568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-web-config\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425612 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.425597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.425798 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.425625 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.526894 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.526751 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527069 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.526895 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527069 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.526936 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527069 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.526962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527069 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.526996 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527069 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.527022 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527069 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.527058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527367 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.527086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527367 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.527121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527367 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.527150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527367 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.527181 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527367 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.527205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527367 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.527226 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-config\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527367 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.527267 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37a25bbf-aed8-47c8-8169-b09decf8995c-config-out\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527367 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.527293 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527367 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.527314 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw4l9\" (UniqueName: \"kubernetes.io/projected/37a25bbf-aed8-47c8-8169-b09decf8995c-kube-api-access-pw4l9\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527367 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.527355 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37a25bbf-aed8-47c8-8169-b09decf8995c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527860 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.527378 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527860 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.527381 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527860 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.527450 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527860 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.527488 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-web-config\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.527860 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.527805 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.528114 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.528028 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.528513 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.528445 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.531532 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.530417 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.531532 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.530563 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.531532 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.530770 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.531532 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.531489 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-config\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.531532 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.531527 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.531881 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.531655 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.533296 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.532910 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37a25bbf-aed8-47c8-8169-b09decf8995c-config-out\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.533721 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.533663 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.534174 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.534135 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.534873 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.534590 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.534873 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.534701 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.534873 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.534710 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.534873 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.534846 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37a25bbf-aed8-47c8-8169-b09decf8995c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.536215 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.534978 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-web-config\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.537788 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.537750 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.540000 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.539977 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw4l9\" (UniqueName: \"kubernetes.io/projected/37a25bbf-aed8-47c8-8169-b09decf8995c-kube-api-access-pw4l9\") pod \"prometheus-k8s-0\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.632569 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.632527 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:29.936769 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.936737 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" event={"ID":"577db653-dd63-4cb2-9754-681662bb5291","Type":"ContainerStarted","Data":"8a7a10fc5ddbc9d76f037bf9f1fed6060df0d9a73e6d1aa6a3d675259dada43f"} Jul 01 16:10:29.942211 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.940296 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02157b73-35d5-4f16-86ba-53c91f0327dd","Type":"ContainerStarted","Data":"d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304"} Jul 01 16:10:29.942211 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.941976 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:10:29.946292 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:10:29.946255 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a25bbf_aed8_47c8_8169_b09decf8995c.slice/crio-1e788210fdf1557ea4f6183a655710c7f825876403b9485030c30c09f2414141 WatchSource:0}: Error finding container 1e788210fdf1557ea4f6183a655710c7f825876403b9485030c30c09f2414141: Status 404 returned error can't find the container with id 1e788210fdf1557ea4f6183a655710c7f825876403b9485030c30c09f2414141 Jul 01 16:10:29.962327 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:29.962260 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" podStartSLOduration=1.041334521 podStartE2EDuration="2.962241192s" totalImagesPullingTime="1.920906671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:29.960388435 +0000 UTC m=+118.012526428" watchObservedRunningTime="2026-07-01 16:10:29.962241192 +0000 UTC m=+118.014379185" Jul 01 16:10:30.359046 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:30.358969 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7a13a04-b781-4af3-a839-8873b0c04557" path="/var/lib/kubelet/pods/a7a13a04-b781-4af3-a839-8873b0c04557/volumes" Jul 01 16:10:30.949934 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:30.949898 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02157b73-35d5-4f16-86ba-53c91f0327dd","Type":"ContainerStarted","Data":"97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd"} Jul 01 16:10:30.950310 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:30.949988 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02157b73-35d5-4f16-86ba-53c91f0327dd","Type":"ContainerStarted","Data":"588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9"} Jul 01 16:10:30.950310 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:30.950031 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02157b73-35d5-4f16-86ba-53c91f0327dd","Type":"ContainerStarted","Data":"c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82"} Jul 01 16:10:30.950310 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:30.950068 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02157b73-35d5-4f16-86ba-53c91f0327dd","Type":"ContainerStarted","Data":"47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c"} Jul 01 16:10:30.951374 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:30.951351 2564 generic.go:356] "Generic (PLEG): container finished" podID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerID="ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace" exitCode=0 Jul 01 16:10:30.951475 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:30.951434 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a25bbf-aed8-47c8-8169-b09decf8995c","Type":"ContainerDied","Data":"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace"} Jul 01 16:10:30.951522 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:30.951486 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a25bbf-aed8-47c8-8169-b09decf8995c","Type":"ContainerStarted","Data":"1e788210fdf1557ea4f6183a655710c7f825876403b9485030c30c09f2414141"} Jul 01 16:10:31.958497 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:31.958465 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02157b73-35d5-4f16-86ba-53c91f0327dd","Type":"ContainerStarted","Data":"42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5"} Jul 01 16:10:31.989170 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:31.989115 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.370509412 podStartE2EDuration="7.989100183s" totalImagesPullingTime="5.604098613s" totalInitContainerRuntime="14.492158ms" isStatefulPod=false podCreationTimestamp="2026-07-01 16:10:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:31.987167252 +0000 UTC m=+120.039305268" watchObservedRunningTime="2026-07-01 16:10:31.989100183 +0000 UTC m=+120.041238175" Jul 01 16:10:34.978191 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:34.978144 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a25bbf-aed8-47c8-8169-b09decf8995c","Type":"ContainerStarted","Data":"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a"} Jul 01 16:10:34.978645 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:34.978234 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a25bbf-aed8-47c8-8169-b09decf8995c","Type":"ContainerStarted","Data":"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7"} Jul 01 16:10:38.995484 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:38.995445 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a25bbf-aed8-47c8-8169-b09decf8995c","Type":"ContainerStarted","Data":"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e"} Jul 01 16:10:38.996023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:38.995520 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a25bbf-aed8-47c8-8169-b09decf8995c","Type":"ContainerStarted","Data":"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218"} Jul 01 16:10:38.996023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:38.995559 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a25bbf-aed8-47c8-8169-b09decf8995c","Type":"ContainerStarted","Data":"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960"} Jul 01 16:10:38.996023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:38.995598 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a25bbf-aed8-47c8-8169-b09decf8995c","Type":"ContainerStarted","Data":"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d"} Jul 01 16:10:39.033121 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:39.033066 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.535739401 podStartE2EDuration="10.033049887s" totalImagesPullingTime="7.472181052s" totalInitContainerRuntime="25.129434ms" isStatefulPod=false podCreationTimestamp="2026-07-01 16:10:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:39.03083976 +0000 UTC m=+127.082977767" watchObservedRunningTime="2026-07-01 16:10:39.033049887 +0000 UTC m=+127.085187880" Jul 01 16:10:39.632971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:39.632931 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:10:42.249632 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:42.249594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs\") pod \"network-metrics-daemon-xffss\" (UID: \"92a3b32f-42e1-4747-8b1d-5a20ed0e7c02\") " pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:10:42.251845 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:42.251827 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92a3b32f-42e1-4747-8b1d-5a20ed0e7c02-metrics-certs\") pod \"network-metrics-daemon-xffss\" (UID: \"92a3b32f-42e1-4747-8b1d-5a20ed0e7c02\") " pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:10:42.476816 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:42.476768 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-v7gln\"" Jul 01 16:10:42.484460 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:42.484439 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xffss" Jul 01 16:10:42.650976 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:42.650952 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xffss"] Jul 01 16:10:42.652146 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:10:42.652117 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a3b32f_42e1_4747_8b1d_5a20ed0e7c02.slice/crio-3b0b061b54c3f137f4a8ed069eb3033c812ee85408d784367ba31d813a3d4a04 WatchSource:0}: Error finding container 3b0b061b54c3f137f4a8ed069eb3033c812ee85408d784367ba31d813a3d4a04: Status 404 returned error can't find the container with id 3b0b061b54c3f137f4a8ed069eb3033c812ee85408d784367ba31d813a3d4a04 Jul 01 16:10:43.012970 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:43.012938 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xffss" event={"ID":"92a3b32f-42e1-4747-8b1d-5a20ed0e7c02","Type":"ContainerStarted","Data":"3b0b061b54c3f137f4a8ed069eb3033c812ee85408d784367ba31d813a3d4a04"} Jul 01 16:10:44.018625 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:44.018580 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xffss" event={"ID":"92a3b32f-42e1-4747-8b1d-5a20ed0e7c02","Type":"ContainerStarted","Data":"6ee59f2b3a211e5be647c470c202ffb65c9c5889be3d786a2e49ef53ac427d7f"} Jul 01 16:10:44.019038 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:44.018684 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xffss" event={"ID":"92a3b32f-42e1-4747-8b1d-5a20ed0e7c02","Type":"ContainerStarted","Data":"8a3e34a0b5699a1f97b2e3acc6b9644fd216124ca53cf3873862711647bb956f"} Jul 01 16:10:44.038363 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:44.038308 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xffss" podStartSLOduration=131.160746078 podStartE2EDuration="2m12.038291031s" totalImagesPullingTime="877.544953ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:08:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:10:44.037206963 +0000 UTC m=+132.089344957" watchObservedRunningTime="2026-07-01 16:10:44.038291031 +0000 UTC m=+132.090429039" Jul 01 16:10:47.031182 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:47.031146 2564 generic.go:356] "Generic (PLEG): container finished" podID="be8e3866-367a-4db4-b049-ed6e537345a2" containerID="a898145457fc61e9493bdfa003bd4e0776a5488cca708c823ecff7f015ec51f9" exitCode=0 Jul 01 16:10:47.031566 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:47.031197 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-t4c2t" event={"ID":"be8e3866-367a-4db4-b049-ed6e537345a2","Type":"ContainerDied","Data":"a898145457fc61e9493bdfa003bd4e0776a5488cca708c823ecff7f015ec51f9"} Jul 01 16:10:47.031566 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:47.031492 2564 scope.go:117] "RemoveContainer" containerID="a898145457fc61e9493bdfa003bd4e0776a5488cca708c823ecff7f015ec51f9" Jul 01 16:10:47.701399 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:47.701364 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:47.701580 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:47.701422 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:10:48.037338 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:48.037256 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-t4c2t" event={"ID":"be8e3866-367a-4db4-b049-ed6e537345a2","Type":"ContainerStarted","Data":"0ed572b2df6bd20bb4470776b36a8abf4a262910d7a72bddbb1665eb41ae3ce5"} Jul 01 16:10:48.107607 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:48.107581 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02157b73-35d5-4f16-86ba-53c91f0327dd/init-config-reloader/0.log" Jul 01 16:10:48.114705 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:48.114683 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02157b73-35d5-4f16-86ba-53c91f0327dd/alertmanager/0.log" Jul 01 16:10:48.203110 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:48.203086 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02157b73-35d5-4f16-86ba-53c91f0327dd/config-reloader/0.log" Jul 01 16:10:48.399370 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:48.399295 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02157b73-35d5-4f16-86ba-53c91f0327dd/kube-rbac-proxy-web/0.log" Jul 01 16:10:48.598415 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:48.598389 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02157b73-35d5-4f16-86ba-53c91f0327dd/kube-rbac-proxy/0.log" Jul 01 16:10:48.798913 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:48.798883 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02157b73-35d5-4f16-86ba-53c91f0327dd/kube-rbac-proxy-metric/0.log" Jul 01 16:10:48.998431 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:48.998400 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02157b73-35d5-4f16-86ba-53c91f0327dd/prom-label-proxy/0.log" Jul 01 16:10:49.999390 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:49.999362 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7fb8f9cf44-6ftqq_577db653-dd63-4cb2-9754-681662bb5291/metrics-server/0.log" Jul 01 16:10:50.401211 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:50.401140 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4spbl_0cef7446-496a-40c6-96ce-967f98a48273/init-textfile/0.log" Jul 01 16:10:50.599971 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:50.599944 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4spbl_0cef7446-496a-40c6-96ce-967f98a48273/node-exporter/0.log" Jul 01 16:10:50.798424 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:50.798399 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4spbl_0cef7446-496a-40c6-96ce-967f98a48273/kube-rbac-proxy/0.log" Jul 01 16:10:52.799172 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:52.799147 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_37a25bbf-aed8-47c8-8169-b09decf8995c/init-config-reloader/0.log" Jul 01 16:10:52.999876 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:52.999837 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_37a25bbf-aed8-47c8-8169-b09decf8995c/prometheus/0.log" Jul 01 16:10:53.199182 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:53.199096 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_37a25bbf-aed8-47c8-8169-b09decf8995c/config-reloader/0.log" Jul 01 16:10:53.399509 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:53.399485 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_37a25bbf-aed8-47c8-8169-b09decf8995c/thanos-sidecar/0.log" Jul 01 16:10:53.603178 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:53.599284 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_37a25bbf-aed8-47c8-8169-b09decf8995c/kube-rbac-proxy-web/0.log" Jul 01 16:10:53.798595 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:53.798567 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_37a25bbf-aed8-47c8-8169-b09decf8995c/kube-rbac-proxy/0.log" Jul 01 16:10:54.001979 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:54.001923 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_37a25bbf-aed8-47c8-8169-b09decf8995c/kube-rbac-proxy-thanos/0.log" Jul 01 16:10:54.200041 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:54.200015 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-lhtqw_90b6d87b-e09d-49bc-86c8-29b65db74e9a/prometheus-operator/0.log" Jul 01 16:10:54.399486 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:54.399413 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-lhtqw_90b6d87b-e09d-49bc-86c8-29b65db74e9a/kube-rbac-proxy/0.log" Jul 01 16:10:56.002802 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:10:56.002753 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-hpjwp_98c4c335-2def-44af-b1a5-933915d2bb6a/networking-console-plugin/0.log" Jul 01 16:11:07.108830 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:07.108787 2564 generic.go:356] "Generic (PLEG): container finished" podID="b5997010-85fd-4486-a9e5-f5ef49c7e238" containerID="45491e30945c724840e05f75fe7ba90343cf42deaa70e5d736b23f98a890a6df" exitCode=0 Jul 01 16:11:07.109319 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:07.108847 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd" event={"ID":"b5997010-85fd-4486-a9e5-f5ef49c7e238","Type":"ContainerDied","Data":"45491e30945c724840e05f75fe7ba90343cf42deaa70e5d736b23f98a890a6df"} Jul 01 16:11:07.109386 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:07.109325 2564 scope.go:117] "RemoveContainer" containerID="45491e30945c724840e05f75fe7ba90343cf42deaa70e5d736b23f98a890a6df" Jul 01 16:11:07.705742 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:07.705716 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:11:07.709392 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:07.709368 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7fb8f9cf44-6ftqq" Jul 01 16:11:08.114689 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:08.114601 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-trfgd" event={"ID":"b5997010-85fd-4486-a9e5-f5ef49c7e238","Type":"ContainerStarted","Data":"87a3b96b92bdd48db40681158e7f47ff38e52b899a32d07c7775f9247034530d"} Jul 01 16:11:29.632891 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:29.632809 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:29.647885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:29.647855 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:30.215007 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:30.214982 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:43.402535 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:43.402496 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:11:43.402996 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:43.402797 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="alertmanager" containerID="cri-o://d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304" gracePeriod=120 Jul 01 16:11:43.402996 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:43.402860 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="kube-rbac-proxy-web" containerID="cri-o://c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82" gracePeriod=120 Jul 01 16:11:43.402996 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:43.402890 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="prom-label-proxy" containerID="cri-o://42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5" gracePeriod=120 Jul 01 16:11:43.402996 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:43.402911 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="config-reloader" containerID="cri-o://47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c" gracePeriod=120 Jul 01 16:11:43.402996 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:43.402936 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="kube-rbac-proxy" containerID="cri-o://588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9" gracePeriod=120 Jul 01 16:11:43.402996 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:43.402861 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="kube-rbac-proxy-metric" containerID="cri-o://97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd" gracePeriod=120 Jul 01 16:11:44.254278 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.254247 2564 generic.go:356] "Generic (PLEG): container finished" podID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerID="42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5" exitCode=0 Jul 01 16:11:44.254278 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.254271 2564 generic.go:356] "Generic (PLEG): container finished" podID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerID="588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9" exitCode=0 Jul 01 16:11:44.254278 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.254278 2564 generic.go:356] "Generic (PLEG): container finished" podID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerID="47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c" exitCode=0 Jul 01 16:11:44.254278 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.254284 2564 generic.go:356] "Generic (PLEG): container finished" podID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerID="d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304" exitCode=0 Jul 01 16:11:44.254543 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.254332 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02157b73-35d5-4f16-86ba-53c91f0327dd","Type":"ContainerDied","Data":"42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5"} Jul 01 16:11:44.254543 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.254401 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02157b73-35d5-4f16-86ba-53c91f0327dd","Type":"ContainerDied","Data":"588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9"} Jul 01 16:11:44.254543 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.254431 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02157b73-35d5-4f16-86ba-53c91f0327dd","Type":"ContainerDied","Data":"47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c"} Jul 01 16:11:44.254543 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.254456 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02157b73-35d5-4f16-86ba-53c91f0327dd","Type":"ContainerDied","Data":"d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304"} Jul 01 16:11:44.661098 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.661072 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:44.795407 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.795332 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02157b73-35d5-4f16-86ba-53c91f0327dd-config-out\") pod \"02157b73-35d5-4f16-86ba-53c91f0327dd\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " Jul 01 16:11:44.795407 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.795382 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02157b73-35d5-4f16-86ba-53c91f0327dd-alertmanager-trusted-ca-bundle\") pod \"02157b73-35d5-4f16-86ba-53c91f0327dd\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " Jul 01 16:11:44.795620 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.795421 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-cluster-tls-config\") pod \"02157b73-35d5-4f16-86ba-53c91f0327dd\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " Jul 01 16:11:44.795620 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.795440 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-config-volume\") pod \"02157b73-35d5-4f16-86ba-53c91f0327dd\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " Jul 01 16:11:44.795620 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.795457 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b25s2\" (UniqueName: \"kubernetes.io/projected/02157b73-35d5-4f16-86ba-53c91f0327dd-kube-api-access-b25s2\") pod \"02157b73-35d5-4f16-86ba-53c91f0327dd\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " Jul 01 16:11:44.795620 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.795529 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02157b73-35d5-4f16-86ba-53c91f0327dd-tls-assets\") pod \"02157b73-35d5-4f16-86ba-53c91f0327dd\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " Jul 01 16:11:44.795620 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.795574 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"02157b73-35d5-4f16-86ba-53c91f0327dd\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " Jul 01 16:11:44.795620 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.795608 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-main-tls\") pod \"02157b73-35d5-4f16-86ba-53c91f0327dd\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " Jul 01 16:11:44.795955 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.795640 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy\") pod \"02157b73-35d5-4f16-86ba-53c91f0327dd\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " Jul 01 16:11:44.795955 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.795674 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02157b73-35d5-4f16-86ba-53c91f0327dd-alertmanager-main-db\") pod \"02157b73-35d5-4f16-86ba-53c91f0327dd\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " Jul 01 16:11:44.795955 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.795703 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02157b73-35d5-4f16-86ba-53c91f0327dd-metrics-client-ca\") pod \"02157b73-35d5-4f16-86ba-53c91f0327dd\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " Jul 01 16:11:44.795955 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.795735 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02157b73-35d5-4f16-86ba-53c91f0327dd-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "02157b73-35d5-4f16-86ba-53c91f0327dd" (UID: "02157b73-35d5-4f16-86ba-53c91f0327dd"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:11:44.795955 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.795745 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy-web\") pod \"02157b73-35d5-4f16-86ba-53c91f0327dd\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " Jul 01 16:11:44.795955 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.795838 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-web-config\") pod \"02157b73-35d5-4f16-86ba-53c91f0327dd\" (UID: \"02157b73-35d5-4f16-86ba-53c91f0327dd\") " Jul 01 16:11:44.796256 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.796143 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02157b73-35d5-4f16-86ba-53c91f0327dd-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:44.796318 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.796251 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02157b73-35d5-4f16-86ba-53c91f0327dd-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "02157b73-35d5-4f16-86ba-53c91f0327dd" (UID: "02157b73-35d5-4f16-86ba-53c91f0327dd"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:11:44.796542 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.796515 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02157b73-35d5-4f16-86ba-53c91f0327dd-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "02157b73-35d5-4f16-86ba-53c91f0327dd" (UID: "02157b73-35d5-4f16-86ba-53c91f0327dd"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:11:44.798862 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.798833 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "02157b73-35d5-4f16-86ba-53c91f0327dd" (UID: "02157b73-35d5-4f16-86ba-53c91f0327dd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:44.799030 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.799005 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02157b73-35d5-4f16-86ba-53c91f0327dd-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "02157b73-35d5-4f16-86ba-53c91f0327dd" (UID: "02157b73-35d5-4f16-86ba-53c91f0327dd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:11:44.799241 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.799211 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "02157b73-35d5-4f16-86ba-53c91f0327dd" (UID: "02157b73-35d5-4f16-86ba-53c91f0327dd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:44.799743 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.799712 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02157b73-35d5-4f16-86ba-53c91f0327dd-config-out" (OuterVolumeSpecName: "config-out") pod "02157b73-35d5-4f16-86ba-53c91f0327dd" (UID: "02157b73-35d5-4f16-86ba-53c91f0327dd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:11:44.800022 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.799947 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "02157b73-35d5-4f16-86ba-53c91f0327dd" (UID: "02157b73-35d5-4f16-86ba-53c91f0327dd"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:44.800022 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.799988 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-config-volume" (OuterVolumeSpecName: "config-volume") pod "02157b73-35d5-4f16-86ba-53c91f0327dd" (UID: "02157b73-35d5-4f16-86ba-53c91f0327dd"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:44.800151 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.800024 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02157b73-35d5-4f16-86ba-53c91f0327dd-kube-api-access-b25s2" (OuterVolumeSpecName: "kube-api-access-b25s2") pod "02157b73-35d5-4f16-86ba-53c91f0327dd" (UID: "02157b73-35d5-4f16-86ba-53c91f0327dd"). InnerVolumeSpecName "kube-api-access-b25s2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:11:44.800151 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.800091 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "02157b73-35d5-4f16-86ba-53c91f0327dd" (UID: "02157b73-35d5-4f16-86ba-53c91f0327dd"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:44.803091 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.803068 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "02157b73-35d5-4f16-86ba-53c91f0327dd" (UID: "02157b73-35d5-4f16-86ba-53c91f0327dd"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:44.809395 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.809373 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-web-config" (OuterVolumeSpecName: "web-config") pod "02157b73-35d5-4f16-86ba-53c91f0327dd" (UID: "02157b73-35d5-4f16-86ba-53c91f0327dd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:44.897181 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.897142 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:44.897181 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.897171 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-main-tls\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:44.897181 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.897182 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:44.897181 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.897192 2564 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02157b73-35d5-4f16-86ba-53c91f0327dd-alertmanager-main-db\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:44.897517 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.897201 2564 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02157b73-35d5-4f16-86ba-53c91f0327dd-metrics-client-ca\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:44.897517 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.897210 2564 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:44.897517 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.897219 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-web-config\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:44.897517 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.897227 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02157b73-35d5-4f16-86ba-53c91f0327dd-config-out\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:44.897517 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.897235 2564 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-cluster-tls-config\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:44.897517 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.897242 2564 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02157b73-35d5-4f16-86ba-53c91f0327dd-config-volume\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:44.897517 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.897250 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b25s2\" (UniqueName: \"kubernetes.io/projected/02157b73-35d5-4f16-86ba-53c91f0327dd-kube-api-access-b25s2\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:44.897517 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:44.897259 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02157b73-35d5-4f16-86ba-53c91f0327dd-tls-assets\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:45.261712 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.261680 2564 generic.go:356] "Generic (PLEG): container finished" podID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerID="97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd" exitCode=0 Jul 01 16:11:45.261712 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.261707 2564 generic.go:356] "Generic (PLEG): container finished" podID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerID="c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82" exitCode=0 Jul 01 16:11:45.261948 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.261753 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.261948 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.261759 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02157b73-35d5-4f16-86ba-53c91f0327dd","Type":"ContainerDied","Data":"97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd"} Jul 01 16:11:45.261948 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.261847 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02157b73-35d5-4f16-86ba-53c91f0327dd","Type":"ContainerDied","Data":"c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82"} Jul 01 16:11:45.261948 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.261876 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02157b73-35d5-4f16-86ba-53c91f0327dd","Type":"ContainerDied","Data":"779e574b6315a770a55c939b3e0b8738c7597ef4b01bd424b6b2ef89b91dcddc"} Jul 01 16:11:45.261948 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.261907 2564 scope.go:117] "RemoveContainer" containerID="42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5" Jul 01 16:11:45.271842 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.271821 2564 scope.go:117] "RemoveContainer" containerID="97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd" Jul 01 16:11:45.279525 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.279502 2564 scope.go:117] "RemoveContainer" containerID="588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9" Jul 01 16:11:45.286967 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.286948 2564 scope.go:117] "RemoveContainer" containerID="c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82" Jul 01 16:11:45.294122 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.294099 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:11:45.294638 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.294616 2564 scope.go:117] "RemoveContainer" containerID="47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c" Jul 01 16:11:45.303327 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.303304 2564 scope.go:117] "RemoveContainer" containerID="d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304" Jul 01 16:11:45.303569 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.303549 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:11:45.310505 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.310482 2564 scope.go:117] "RemoveContainer" containerID="9d583aae7f3b8bc2b5f5b98c3957c7b531f1680fee6758160563c46971c3a57f" Jul 01 16:11:45.317276 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.317258 2564 scope.go:117] "RemoveContainer" containerID="42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5" Jul 01 16:11:45.317548 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:11:45.317529 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5\": container with ID starting with 42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5 not found: ID does not exist" containerID="42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5" Jul 01 16:11:45.317593 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.317557 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5"} err="failed to get container status \"42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5\": rpc error: code = NotFound desc = could not find container \"42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5\": container with ID starting with 42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5 not found: ID does not exist" Jul 01 16:11:45.317593 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.317577 2564 scope.go:117] "RemoveContainer" containerID="97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd" Jul 01 16:11:45.317822 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:11:45.317802 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd\": container with ID starting with 97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd not found: ID does not exist" containerID="97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd" Jul 01 16:11:45.317879 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.317828 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd"} err="failed to get container status \"97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd\": rpc error: code = NotFound desc = could not find container \"97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd\": container with ID starting with 97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd not found: ID does not exist" Jul 01 16:11:45.317879 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.317844 2564 scope.go:117] "RemoveContainer" containerID="588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9" Jul 01 16:11:45.318078 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:11:45.318062 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9\": container with ID starting with 588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9 not found: ID does not exist" containerID="588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9" Jul 01 16:11:45.318121 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.318083 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9"} err="failed to get container status \"588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9\": rpc error: code = NotFound desc = could not find container \"588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9\": container with ID starting with 588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9 not found: ID does not exist" Jul 01 16:11:45.318121 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.318098 2564 scope.go:117] "RemoveContainer" containerID="c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82" Jul 01 16:11:45.318311 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:11:45.318295 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82\": container with ID starting with c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82 not found: ID does not exist" containerID="c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82" Jul 01 16:11:45.318350 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.318315 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82"} err="failed to get container status \"c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82\": rpc error: code = NotFound desc = could not find container \"c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82\": container with ID starting with c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82 not found: ID does not exist" Jul 01 16:11:45.318350 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.318327 2564 scope.go:117] "RemoveContainer" containerID="47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c" Jul 01 16:11:45.318513 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:11:45.318498 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c\": container with ID starting with 47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c not found: ID does not exist" containerID="47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c" Jul 01 16:11:45.318555 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.318517 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c"} err="failed to get container status \"47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c\": rpc error: code = NotFound desc = could not find container \"47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c\": container with ID starting with 47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c not found: ID does not exist" Jul 01 16:11:45.318555 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.318530 2564 scope.go:117] "RemoveContainer" containerID="d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304" Jul 01 16:11:45.318745 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:11:45.318730 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304\": container with ID starting with d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304 not found: ID does not exist" containerID="d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304" Jul 01 16:11:45.318823 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.318748 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304"} err="failed to get container status \"d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304\": rpc error: code = NotFound desc = could not find container \"d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304\": container with ID starting with d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304 not found: ID does not exist" Jul 01 16:11:45.318823 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.318759 2564 scope.go:117] "RemoveContainer" containerID="9d583aae7f3b8bc2b5f5b98c3957c7b531f1680fee6758160563c46971c3a57f" Jul 01 16:11:45.318959 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:11:45.318945 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d583aae7f3b8bc2b5f5b98c3957c7b531f1680fee6758160563c46971c3a57f\": container with ID starting with 9d583aae7f3b8bc2b5f5b98c3957c7b531f1680fee6758160563c46971c3a57f not found: ID does not exist" containerID="9d583aae7f3b8bc2b5f5b98c3957c7b531f1680fee6758160563c46971c3a57f" Jul 01 16:11:45.319010 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.318960 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d583aae7f3b8bc2b5f5b98c3957c7b531f1680fee6758160563c46971c3a57f"} err="failed to get container status \"9d583aae7f3b8bc2b5f5b98c3957c7b531f1680fee6758160563c46971c3a57f\": rpc error: code = NotFound desc = could not find container \"9d583aae7f3b8bc2b5f5b98c3957c7b531f1680fee6758160563c46971c3a57f\": container with ID starting with 9d583aae7f3b8bc2b5f5b98c3957c7b531f1680fee6758160563c46971c3a57f not found: ID does not exist" Jul 01 16:11:45.319010 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.318973 2564 scope.go:117] "RemoveContainer" containerID="42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5" Jul 01 16:11:45.319163 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.319148 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5"} err="failed to get container status \"42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5\": rpc error: code = NotFound desc = could not find container \"42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5\": container with ID starting with 42b9dc4ee6df9e00dbd25c43636e648063351bbf7398e386710bc40a25fd69f5 not found: ID does not exist" Jul 01 16:11:45.319203 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.319163 2564 scope.go:117] "RemoveContainer" containerID="97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd" Jul 01 16:11:45.319325 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.319310 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd"} err="failed to get container status \"97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd\": rpc error: code = NotFound desc = could not find container \"97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd\": container with ID starting with 97f8ec26511fcf32de7798ef8a6397871d31118634cda91f63ee3df4732f5bfd not found: ID does not exist" Jul 01 16:11:45.319373 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.319325 2564 scope.go:117] "RemoveContainer" containerID="588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9" Jul 01 16:11:45.319505 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.319491 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9"} err="failed to get container status \"588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9\": rpc error: code = NotFound desc = could not find container \"588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9\": container with ID starting with 588edef483928911f145bce36995ec9fc5c4e6d22111533cfa01a9aa27c12ec9 not found: ID does not exist" Jul 01 16:11:45.319505 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.319504 2564 scope.go:117] "RemoveContainer" containerID="c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82" Jul 01 16:11:45.319682 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.319667 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82"} err="failed to get container status \"c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82\": rpc error: code = NotFound desc = could not find container \"c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82\": container with ID starting with c108e970928ec6ab9f86a42a235b7a1e94a3121cbc7a406c9358834a186dbe82 not found: ID does not exist" Jul 01 16:11:45.319682 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.319681 2564 scope.go:117] "RemoveContainer" containerID="47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c" Jul 01 16:11:45.319908 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.319890 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c"} err="failed to get container status \"47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c\": rpc error: code = NotFound desc = could not find container \"47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c\": container with ID starting with 47b9b774f55f0f40cd06217c0962b87bbc8928fdb1520b480b790934355f1a8c not found: ID does not exist" Jul 01 16:11:45.319949 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.319910 2564 scope.go:117] "RemoveContainer" containerID="d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304" Jul 01 16:11:45.320093 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.320078 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304"} err="failed to get container status \"d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304\": rpc error: code = NotFound desc = could not find container \"d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304\": container with ID starting with d5c5ab13da8e023cc18055daa6f83b6ce7d5a24d30d543dddd9f0589d3afc304 not found: ID does not exist" Jul 01 16:11:45.320133 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.320093 2564 scope.go:117] "RemoveContainer" containerID="9d583aae7f3b8bc2b5f5b98c3957c7b531f1680fee6758160563c46971c3a57f" Jul 01 16:11:45.320277 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.320263 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d583aae7f3b8bc2b5f5b98c3957c7b531f1680fee6758160563c46971c3a57f"} err="failed to get container status \"9d583aae7f3b8bc2b5f5b98c3957c7b531f1680fee6758160563c46971c3a57f\": rpc error: code = NotFound desc = could not find container \"9d583aae7f3b8bc2b5f5b98c3957c7b531f1680fee6758160563c46971c3a57f\": container with ID starting with 9d583aae7f3b8bc2b5f5b98c3957c7b531f1680fee6758160563c46971c3a57f not found: ID does not exist" Jul 01 16:11:45.336504 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336469 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:11:45.336763 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336750 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="config-reloader" Jul 01 16:11:45.336837 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336766 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="config-reloader" Jul 01 16:11:45.336837 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336792 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="kube-rbac-proxy" Jul 01 16:11:45.336837 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336797 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="kube-rbac-proxy" Jul 01 16:11:45.336837 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336807 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="init-config-reloader" Jul 01 16:11:45.336837 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336816 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="init-config-reloader" Jul 01 16:11:45.336837 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336827 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="kube-rbac-proxy-metric" Jul 01 16:11:45.336837 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336832 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="kube-rbac-proxy-metric" Jul 01 16:11:45.337050 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336841 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="alertmanager" Jul 01 16:11:45.337050 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336846 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="alertmanager" Jul 01 16:11:45.337050 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336859 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="prom-label-proxy" Jul 01 16:11:45.337050 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336864 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="prom-label-proxy" Jul 01 16:11:45.337050 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336870 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="kube-rbac-proxy-web" Jul 01 16:11:45.337050 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336875 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="kube-rbac-proxy-web" Jul 01 16:11:45.337050 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336922 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="kube-rbac-proxy-metric" Jul 01 16:11:45.337050 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336929 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="kube-rbac-proxy" Jul 01 16:11:45.337050 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336935 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="prom-label-proxy" Jul 01 16:11:45.337050 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336940 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="kube-rbac-proxy-web" Jul 01 16:11:45.337050 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336946 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="config-reloader" Jul 01 16:11:45.337050 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.336953 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" containerName="alertmanager" Jul 01 16:11:45.342494 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.342470 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.345521 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.345500 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 16:11:45.345655 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.345535 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 16:11:45.345655 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.345542 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 16:11:45.345655 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.345584 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 16:11:45.345655 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.345627 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 16:11:45.345655 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.345590 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 16:11:45.345903 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.345872 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 16:11:45.346029 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.346001 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9mdz5\"" Jul 01 16:11:45.346350 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.346334 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 16:11:45.350576 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.350556 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 16:11:45.354870 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.354848 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:11:45.502928 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.502884 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.502928 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.502923 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bbcc3a2c-34de-4a0e-8476-af7292828d7f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.503134 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.502952 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.503134 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.503022 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45c2b\" (UniqueName: \"kubernetes.io/projected/bbcc3a2c-34de-4a0e-8476-af7292828d7f-kube-api-access-45c2b\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.503134 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.503064 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbcc3a2c-34de-4a0e-8476-af7292828d7f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.503134 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.503083 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbcc3a2c-34de-4a0e-8476-af7292828d7f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.503134 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.503117 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.503284 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.503144 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbcc3a2c-34de-4a0e-8476-af7292828d7f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.503284 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.503162 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.503284 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.503204 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.503284 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.503252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbcc3a2c-34de-4a0e-8476-af7292828d7f-config-out\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.503284 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.503279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-web-config\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.503481 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.503309 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-config-volume\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.604505 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.604426 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.604505 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.604464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bbcc3a2c-34de-4a0e-8476-af7292828d7f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.604694 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.604518 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.604694 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.604551 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45c2b\" (UniqueName: \"kubernetes.io/projected/bbcc3a2c-34de-4a0e-8476-af7292828d7f-kube-api-access-45c2b\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.604694 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.604579 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbcc3a2c-34de-4a0e-8476-af7292828d7f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.604694 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.604607 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbcc3a2c-34de-4a0e-8476-af7292828d7f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.604694 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.604642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.604694 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.604671 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbcc3a2c-34de-4a0e-8476-af7292828d7f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.604990 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.604699 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.604990 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.604739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.604990 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.604826 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbcc3a2c-34de-4a0e-8476-af7292828d7f-config-out\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.604990 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.604862 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-web-config\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.604990 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.604887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-config-volume\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.605191 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.605053 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bbcc3a2c-34de-4a0e-8476-af7292828d7f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.606013 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.605636 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bbcc3a2c-34de-4a0e-8476-af7292828d7f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.606013 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.605703 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bbcc3a2c-34de-4a0e-8476-af7292828d7f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.607822 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.607578 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bbcc3a2c-34de-4a0e-8476-af7292828d7f-config-out\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.607822 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.607701 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.608007 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.607964 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-config-volume\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.608182 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.608132 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.608405 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.608379 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.608514 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.608489 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.608578 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.608544 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-web-config\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.609112 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.609096 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bbcc3a2c-34de-4a0e-8476-af7292828d7f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.609656 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.609634 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bbcc3a2c-34de-4a0e-8476-af7292828d7f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.615065 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.615044 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45c2b\" (UniqueName: \"kubernetes.io/projected/bbcc3a2c-34de-4a0e-8476-af7292828d7f-kube-api-access-45c2b\") pod \"alertmanager-main-0\" (UID: \"bbcc3a2c-34de-4a0e-8476-af7292828d7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.652565 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.652530 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 16:11:45.794758 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:45.794729 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 16:11:45.795108 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:11:45.794865 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbcc3a2c_34de_4a0e_8476_af7292828d7f.slice/crio-c14876714dcb4311eccbc8b53151f30084df690329d1fc0fd4cbc165c161504c WatchSource:0}: Error finding container c14876714dcb4311eccbc8b53151f30084df690329d1fc0fd4cbc165c161504c: Status 404 returned error can't find the container with id c14876714dcb4311eccbc8b53151f30084df690329d1fc0fd4cbc165c161504c Jul 01 16:11:46.267170 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:46.267138 2564 generic.go:356] "Generic (PLEG): container finished" podID="bbcc3a2c-34de-4a0e-8476-af7292828d7f" containerID="38dbf71a5fd32d553f0ab1c02604efb18c8e7e0cd5a5a137078b1d65564c57d3" exitCode=0 Jul 01 16:11:46.267331 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:46.267225 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbcc3a2c-34de-4a0e-8476-af7292828d7f","Type":"ContainerDied","Data":"38dbf71a5fd32d553f0ab1c02604efb18c8e7e0cd5a5a137078b1d65564c57d3"} Jul 01 16:11:46.267331 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:46.267299 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbcc3a2c-34de-4a0e-8476-af7292828d7f","Type":"ContainerStarted","Data":"c14876714dcb4311eccbc8b53151f30084df690329d1fc0fd4cbc165c161504c"} Jul 01 16:11:46.359652 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:46.359626 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02157b73-35d5-4f16-86ba-53c91f0327dd" path="/var/lib/kubelet/pods/02157b73-35d5-4f16-86ba-53c91f0327dd/volumes" Jul 01 16:11:47.276264 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:47.276232 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbcc3a2c-34de-4a0e-8476-af7292828d7f","Type":"ContainerStarted","Data":"f78e3ac3cac2b8c52408ebcad1d0ddd965409c1bfaeb060cbf14e2dcb0d3fcc9"} Jul 01 16:11:47.276646 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:47.276297 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbcc3a2c-34de-4a0e-8476-af7292828d7f","Type":"ContainerStarted","Data":"dc75e1c42cc403a2566131af42dda03d8496633cf0032b2a32692be17a44a813"} Jul 01 16:11:47.276646 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:47.276329 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbcc3a2c-34de-4a0e-8476-af7292828d7f","Type":"ContainerStarted","Data":"6bb16212d51ac642e14895f47932e05cbf3a66e41b71b057ad6c99bab951f3fb"} Jul 01 16:11:47.276646 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:47.276357 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbcc3a2c-34de-4a0e-8476-af7292828d7f","Type":"ContainerStarted","Data":"9c49393bdb06ecc211fe68f2c371f44936f5f9e9a4ab4dbcae74cff09452522c"} Jul 01 16:11:47.276646 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:47.276382 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbcc3a2c-34de-4a0e-8476-af7292828d7f","Type":"ContainerStarted","Data":"bcbf7ce2044ef4d699bfd21b94dd87c6df41cf7a973a4464463ad6616d06d7db"} Jul 01 16:11:47.276646 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:47.276422 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bbcc3a2c-34de-4a0e-8476-af7292828d7f","Type":"ContainerStarted","Data":"fc12433cd0f548a1a59eef47fca6e6424939a8a1ad21f6f05d6018631a4282f9"} Jul 01 16:11:47.309465 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:47.309407 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.2934606779999998 podStartE2EDuration="2.309388458s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.92778ms" isStatefulPod=false podCreationTimestamp="2026-07-01 16:11:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:11:47.308596088 +0000 UTC m=+195.360734083" watchObservedRunningTime="2026-07-01 16:11:47.309388458 +0000 UTC m=+195.361526455" Jul 01 16:11:47.744814 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:47.744764 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:11:47.745285 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:47.745081 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="prometheus" containerID="cri-o://0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7" gracePeriod=600 Jul 01 16:11:47.745285 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:47.745132 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="kube-rbac-proxy-web" containerID="cri-o://8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960" gracePeriod=600 Jul 01 16:11:47.745285 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:47.745141 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="config-reloader" containerID="cri-o://da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a" gracePeriod=600 Jul 01 16:11:47.745285 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:47.745147 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="thanos-sidecar" containerID="cri-o://0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d" gracePeriod=600 Jul 01 16:11:47.745285 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:47.745134 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e" gracePeriod=600 Jul 01 16:11:47.745285 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:47.745105 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="kube-rbac-proxy" containerID="cri-o://5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218" gracePeriod=600 Jul 01 16:11:47.997135 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:47.997072 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.129963 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.129923 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-db\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.130129 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.129974 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw4l9\" (UniqueName: \"kubernetes.io/projected/37a25bbf-aed8-47c8-8169-b09decf8995c-kube-api-access-pw4l9\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.130129 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130001 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-tls\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.130129 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130018 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-0\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.130129 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130036 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-serving-certs-ca-bundle\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.130129 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130075 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-2\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.130129 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130115 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37a25bbf-aed8-47c8-8169-b09decf8995c-config-out\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.130465 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130392 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:11:48.130465 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130453 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-kubelet-serving-ca-bundle\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.130567 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130463 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:11:48.130567 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130485 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-metrics-client-certs\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.130567 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130517 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-kube-rbac-proxy\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.130567 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130562 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37a25bbf-aed8-47c8-8169-b09decf8995c-tls-assets\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.130760 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130597 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.130760 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130621 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-web-config\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.130760 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130656 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-thanos-prometheus-http-client-file\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.130760 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130705 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-1\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.130760 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130732 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-grpc-tls\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.130760 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130734 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:11:48.130760 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130755 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-config\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.131132 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130794 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-trusted-ca-bundle\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.131132 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130824 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.131132 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.130850 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-metrics-client-ca\") pod \"37a25bbf-aed8-47c8-8169-b09decf8995c\" (UID: \"37a25bbf-aed8-47c8-8169-b09decf8995c\") " Jul 01 16:11:48.131132 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.131075 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:11:48.131316 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.131136 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.131316 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.131157 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.131316 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.131172 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.131316 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.131168 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:11:48.131591 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.131317 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:11:48.132667 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.132556 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:11:48.132768 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.132690 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 16:11:48.132955 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.132930 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:48.133255 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.133216 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37a25bbf-aed8-47c8-8169-b09decf8995c-kube-api-access-pw4l9" (OuterVolumeSpecName: "kube-api-access-pw4l9") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "kube-api-access-pw4l9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:11:48.133548 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.133436 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:48.133548 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.133513 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:48.134139 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.134113 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:48.134640 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.134606 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37a25bbf-aed8-47c8-8169-b09decf8995c-config-out" (OuterVolumeSpecName: "config-out") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 16:11:48.134817 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.134795 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37a25bbf-aed8-47c8-8169-b09decf8995c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:11:48.134960 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.134931 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:48.135021 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.134973 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-config" (OuterVolumeSpecName: "config") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:48.135062 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.135030 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:48.135402 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.135380 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:48.144400 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.144369 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-web-config" (OuterVolumeSpecName: "web-config") pod "37a25bbf-aed8-47c8-8169-b09decf8995c" (UID: "37a25bbf-aed8-47c8-8169-b09decf8995c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 16:11:48.231558 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.231515 2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.231558 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.231545 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.231558 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.231556 2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-grpc-tls\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.231822 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.231569 2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-config\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.231822 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.231585 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.231822 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.231598 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.231822 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.231612 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-configmap-metrics-client-ca\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.231822 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.231626 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-db\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.231822 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.231636 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw4l9\" (UniqueName: \"kubernetes.io/projected/37a25bbf-aed8-47c8-8169-b09decf8995c-kube-api-access-pw4l9\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.231822 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.231646 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.231822 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.231656 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/37a25bbf-aed8-47c8-8169-b09decf8995c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.231822 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.231665 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37a25bbf-aed8-47c8-8169-b09decf8995c-config-out\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.231822 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.231672 2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-metrics-client-certs\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.231822 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.231680 2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-kube-rbac-proxy\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.231822 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.231690 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37a25bbf-aed8-47c8-8169-b09decf8995c-tls-assets\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.231822 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.231699 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.231822 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.231708 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37a25bbf-aed8-47c8-8169-b09decf8995c-web-config\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:11:48.283494 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.283408 2564 generic.go:356] "Generic (PLEG): container finished" podID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerID="a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e" exitCode=0 Jul 01 16:11:48.283494 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.283436 2564 generic.go:356] "Generic (PLEG): container finished" podID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerID="5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218" exitCode=0 Jul 01 16:11:48.283494 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.283443 2564 generic.go:356] "Generic (PLEG): container finished" podID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerID="8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960" exitCode=0 Jul 01 16:11:48.283494 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.283452 2564 generic.go:356] "Generic (PLEG): container finished" podID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerID="0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d" exitCode=0 Jul 01 16:11:48.283494 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.283459 2564 generic.go:356] "Generic (PLEG): container finished" podID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerID="da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a" exitCode=0 Jul 01 16:11:48.283494 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.283464 2564 generic.go:356] "Generic (PLEG): container finished" podID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerID="0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7" exitCode=0 Jul 01 16:11:48.284241 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.283496 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.284241 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.283502 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a25bbf-aed8-47c8-8169-b09decf8995c","Type":"ContainerDied","Data":"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e"} Jul 01 16:11:48.284241 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.283578 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a25bbf-aed8-47c8-8169-b09decf8995c","Type":"ContainerDied","Data":"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218"} Jul 01 16:11:48.284241 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.283614 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a25bbf-aed8-47c8-8169-b09decf8995c","Type":"ContainerDied","Data":"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960"} Jul 01 16:11:48.284241 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.283641 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a25bbf-aed8-47c8-8169-b09decf8995c","Type":"ContainerDied","Data":"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d"} Jul 01 16:11:48.284241 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.283659 2564 scope.go:117] "RemoveContainer" containerID="a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e" Jul 01 16:11:48.284241 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.283679 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a25bbf-aed8-47c8-8169-b09decf8995c","Type":"ContainerDied","Data":"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a"} Jul 01 16:11:48.284241 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.283721 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a25bbf-aed8-47c8-8169-b09decf8995c","Type":"ContainerDied","Data":"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7"} Jul 01 16:11:48.284241 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.283759 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"37a25bbf-aed8-47c8-8169-b09decf8995c","Type":"ContainerDied","Data":"1e788210fdf1557ea4f6183a655710c7f825876403b9485030c30c09f2414141"} Jul 01 16:11:48.292056 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.292037 2564 scope.go:117] "RemoveContainer" containerID="5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218" Jul 01 16:11:48.298870 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.298852 2564 scope.go:117] "RemoveContainer" containerID="8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960" Jul 01 16:11:48.305654 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.305637 2564 scope.go:117] "RemoveContainer" containerID="0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d" Jul 01 16:11:48.310377 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.310356 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:11:48.312816 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.312803 2564 scope.go:117] "RemoveContainer" containerID="da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a" Jul 01 16:11:48.321744 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.321477 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:11:48.321744 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.321733 2564 scope.go:117] "RemoveContainer" containerID="0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7" Jul 01 16:11:48.329225 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.329209 2564 scope.go:117] "RemoveContainer" containerID="ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace" Jul 01 16:11:48.335961 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.335943 2564 scope.go:117] "RemoveContainer" containerID="a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e" Jul 01 16:11:48.336200 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:11:48.336179 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e\": container with ID starting with a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e not found: ID does not exist" containerID="a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e" Jul 01 16:11:48.336292 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.336207 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e"} err="failed to get container status \"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e\": rpc error: code = NotFound desc = could not find container \"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e\": container with ID starting with a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e not found: ID does not exist" Jul 01 16:11:48.336292 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.336226 2564 scope.go:117] "RemoveContainer" containerID="5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218" Jul 01 16:11:48.336435 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:11:48.336419 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218\": container with ID starting with 5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218 not found: ID does not exist" containerID="5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218" Jul 01 16:11:48.336477 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.336441 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218"} err="failed to get container status \"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218\": rpc error: code = NotFound desc = could not find container \"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218\": container with ID starting with 5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218 not found: ID does not exist" Jul 01 16:11:48.336477 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.336455 2564 scope.go:117] "RemoveContainer" containerID="8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960" Jul 01 16:11:48.336700 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:11:48.336684 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960\": container with ID starting with 8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960 not found: ID does not exist" containerID="8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960" Jul 01 16:11:48.336733 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.336714 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960"} err="failed to get container status \"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960\": rpc error: code = NotFound desc = could not find container \"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960\": container with ID starting with 8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960 not found: ID does not exist" Jul 01 16:11:48.336733 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.336730 2564 scope.go:117] "RemoveContainer" containerID="0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d" Jul 01 16:11:48.337016 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:11:48.336985 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d\": container with ID starting with 0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d not found: ID does not exist" containerID="0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d" Jul 01 16:11:48.337066 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.337022 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d"} err="failed to get container status \"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d\": rpc error: code = NotFound desc = could not find container \"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d\": container with ID starting with 0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d not found: ID does not exist" Jul 01 16:11:48.337066 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.337035 2564 scope.go:117] "RemoveContainer" containerID="da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a" Jul 01 16:11:48.337250 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:11:48.337233 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a\": container with ID starting with da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a not found: ID does not exist" containerID="da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a" Jul 01 16:11:48.337292 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.337255 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a"} err="failed to get container status \"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a\": rpc error: code = NotFound desc = could not find container \"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a\": container with ID starting with da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a not found: ID does not exist" Jul 01 16:11:48.337292 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.337269 2564 scope.go:117] "RemoveContainer" containerID="0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7" Jul 01 16:11:48.337502 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:11:48.337477 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7\": container with ID starting with 0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7 not found: ID does not exist" containerID="0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7" Jul 01 16:11:48.337543 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.337505 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7"} err="failed to get container status \"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7\": rpc error: code = NotFound desc = could not find container \"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7\": container with ID starting with 0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7 not found: ID does not exist" Jul 01 16:11:48.337543 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.337519 2564 scope.go:117] "RemoveContainer" containerID="ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace" Jul 01 16:11:48.337715 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:11:48.337701 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace\": container with ID starting with ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace not found: ID does not exist" containerID="ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace" Jul 01 16:11:48.337757 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.337719 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace"} err="failed to get container status \"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace\": rpc error: code = NotFound desc = could not find container \"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace\": container with ID starting with ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace not found: ID does not exist" Jul 01 16:11:48.337757 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.337732 2564 scope.go:117] "RemoveContainer" containerID="a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e" Jul 01 16:11:48.337982 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.337964 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e"} err="failed to get container status \"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e\": rpc error: code = NotFound desc = could not find container \"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e\": container with ID starting with a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e not found: ID does not exist" Jul 01 16:11:48.338029 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.337983 2564 scope.go:117] "RemoveContainer" containerID="5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218" Jul 01 16:11:48.338189 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.338172 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218"} err="failed to get container status \"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218\": rpc error: code = NotFound desc = could not find container \"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218\": container with ID starting with 5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218 not found: ID does not exist" Jul 01 16:11:48.338228 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.338190 2564 scope.go:117] "RemoveContainer" containerID="8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960" Jul 01 16:11:48.338406 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.338389 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960"} err="failed to get container status \"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960\": rpc error: code = NotFound desc = could not find container \"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960\": container with ID starting with 8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960 not found: ID does not exist" Jul 01 16:11:48.338448 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.338406 2564 scope.go:117] "RemoveContainer" containerID="0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d" Jul 01 16:11:48.338608 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.338592 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d"} err="failed to get container status \"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d\": rpc error: code = NotFound desc = could not find container \"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d\": container with ID starting with 0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d not found: ID does not exist" Jul 01 16:11:48.338671 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.338608 2564 scope.go:117] "RemoveContainer" containerID="da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a" Jul 01 16:11:48.338830 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.338809 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a"} err="failed to get container status \"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a\": rpc error: code = NotFound desc = could not find container \"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a\": container with ID starting with da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a not found: ID does not exist" Jul 01 16:11:48.338893 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.338831 2564 scope.go:117] "RemoveContainer" containerID="0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7" Jul 01 16:11:48.339073 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.339052 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7"} err="failed to get container status \"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7\": rpc error: code = NotFound desc = could not find container \"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7\": container with ID starting with 0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7 not found: ID does not exist" Jul 01 16:11:48.339073 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.339069 2564 scope.go:117] "RemoveContainer" containerID="ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace" Jul 01 16:11:48.339320 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.339302 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace"} err="failed to get container status \"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace\": rpc error: code = NotFound desc = could not find container \"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace\": container with ID starting with ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace not found: ID does not exist" Jul 01 16:11:48.339320 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.339319 2564 scope.go:117] "RemoveContainer" containerID="a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e" Jul 01 16:11:48.339545 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.339530 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e"} err="failed to get container status \"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e\": rpc error: code = NotFound desc = could not find container \"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e\": container with ID starting with a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e not found: ID does not exist" Jul 01 16:11:48.339545 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.339544 2564 scope.go:117] "RemoveContainer" containerID="5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218" Jul 01 16:11:48.339740 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.339722 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218"} err="failed to get container status \"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218\": rpc error: code = NotFound desc = could not find container \"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218\": container with ID starting with 5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218 not found: ID does not exist" Jul 01 16:11:48.339835 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.339742 2564 scope.go:117] "RemoveContainer" containerID="8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960" Jul 01 16:11:48.339963 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.339946 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960"} err="failed to get container status \"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960\": rpc error: code = NotFound desc = could not find container \"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960\": container with ID starting with 8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960 not found: ID does not exist" Jul 01 16:11:48.340030 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.339966 2564 scope.go:117] "RemoveContainer" containerID="0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d" Jul 01 16:11:48.340144 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.340127 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d"} err="failed to get container status \"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d\": rpc error: code = NotFound desc = could not find container \"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d\": container with ID starting with 0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d not found: ID does not exist" Jul 01 16:11:48.340207 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.340146 2564 scope.go:117] "RemoveContainer" containerID="da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a" Jul 01 16:11:48.340354 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.340339 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a"} err="failed to get container status \"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a\": rpc error: code = NotFound desc = could not find container \"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a\": container with ID starting with da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a not found: ID does not exist" Jul 01 16:11:48.340443 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.340356 2564 scope.go:117] "RemoveContainer" containerID="0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7" Jul 01 16:11:48.340540 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.340524 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7"} err="failed to get container status \"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7\": rpc error: code = NotFound desc = could not find container \"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7\": container with ID starting with 0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7 not found: ID does not exist" Jul 01 16:11:48.340597 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.340541 2564 scope.go:117] "RemoveContainer" containerID="ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace" Jul 01 16:11:48.340717 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.340702 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace"} err="failed to get container status \"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace\": rpc error: code = NotFound desc = could not find container \"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace\": container with ID starting with ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace not found: ID does not exist" Jul 01 16:11:48.340790 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.340718 2564 scope.go:117] "RemoveContainer" containerID="a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e" Jul 01 16:11:48.340912 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.340897 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e"} err="failed to get container status \"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e\": rpc error: code = NotFound desc = could not find container \"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e\": container with ID starting with a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e not found: ID does not exist" Jul 01 16:11:48.340980 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.340914 2564 scope.go:117] "RemoveContainer" containerID="5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218" Jul 01 16:11:48.341120 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.341103 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218"} err="failed to get container status \"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218\": rpc error: code = NotFound desc = could not find container \"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218\": container with ID starting with 5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218 not found: ID does not exist" Jul 01 16:11:48.341164 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.341121 2564 scope.go:117] "RemoveContainer" containerID="8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960" Jul 01 16:11:48.341308 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.341292 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960"} err="failed to get container status \"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960\": rpc error: code = NotFound desc = could not find container \"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960\": container with ID starting with 8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960 not found: ID does not exist" Jul 01 16:11:48.341374 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.341310 2564 scope.go:117] "RemoveContainer" containerID="0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d" Jul 01 16:11:48.341498 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.341483 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d"} err="failed to get container status \"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d\": rpc error: code = NotFound desc = could not find container \"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d\": container with ID starting with 0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d not found: ID does not exist" Jul 01 16:11:48.341543 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.341499 2564 scope.go:117] "RemoveContainer" containerID="da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a" Jul 01 16:11:48.341669 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.341652 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a"} err="failed to get container status \"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a\": rpc error: code = NotFound desc = could not find container \"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a\": container with ID starting with da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a not found: ID does not exist" Jul 01 16:11:48.341732 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.341670 2564 scope.go:117] "RemoveContainer" containerID="0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7" Jul 01 16:11:48.341885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.341870 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7"} err="failed to get container status \"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7\": rpc error: code = NotFound desc = could not find container \"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7\": container with ID starting with 0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7 not found: ID does not exist" Jul 01 16:11:48.341928 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.341885 2564 scope.go:117] "RemoveContainer" containerID="ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace" Jul 01 16:11:48.342086 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.342071 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace"} err="failed to get container status \"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace\": rpc error: code = NotFound desc = could not find container \"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace\": container with ID starting with ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace not found: ID does not exist" Jul 01 16:11:48.342131 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.342086 2564 scope.go:117] "RemoveContainer" containerID="a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e" Jul 01 16:11:48.342266 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.342250 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e"} err="failed to get container status \"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e\": rpc error: code = NotFound desc = could not find container \"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e\": container with ID starting with a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e not found: ID does not exist" Jul 01 16:11:48.342309 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.342266 2564 scope.go:117] "RemoveContainer" containerID="5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218" Jul 01 16:11:48.342486 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.342469 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218"} err="failed to get container status \"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218\": rpc error: code = NotFound desc = could not find container \"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218\": container with ID starting with 5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218 not found: ID does not exist" Jul 01 16:11:48.342554 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.342488 2564 scope.go:117] "RemoveContainer" containerID="8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960" Jul 01 16:11:48.342684 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.342669 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960"} err="failed to get container status \"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960\": rpc error: code = NotFound desc = could not find container \"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960\": container with ID starting with 8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960 not found: ID does not exist" Jul 01 16:11:48.342726 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.342684 2564 scope.go:117] "RemoveContainer" containerID="0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d" Jul 01 16:11:48.342893 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.342878 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d"} err="failed to get container status \"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d\": rpc error: code = NotFound desc = could not find container \"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d\": container with ID starting with 0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d not found: ID does not exist" Jul 01 16:11:48.342946 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.342893 2564 scope.go:117] "RemoveContainer" containerID="da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a" Jul 01 16:11:48.343081 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.343066 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a"} err="failed to get container status \"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a\": rpc error: code = NotFound desc = could not find container \"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a\": container with ID starting with da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a not found: ID does not exist" Jul 01 16:11:48.343126 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.343081 2564 scope.go:117] "RemoveContainer" containerID="0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7" Jul 01 16:11:48.343247 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.343230 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7"} err="failed to get container status \"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7\": rpc error: code = NotFound desc = could not find container \"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7\": container with ID starting with 0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7 not found: ID does not exist" Jul 01 16:11:48.343321 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.343249 2564 scope.go:117] "RemoveContainer" containerID="ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace" Jul 01 16:11:48.343427 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.343412 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace"} err="failed to get container status \"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace\": rpc error: code = NotFound desc = could not find container \"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace\": container with ID starting with ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace not found: ID does not exist" Jul 01 16:11:48.343463 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.343428 2564 scope.go:117] "RemoveContainer" containerID="a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e" Jul 01 16:11:48.343612 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.343593 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e"} err="failed to get container status \"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e\": rpc error: code = NotFound desc = could not find container \"a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e\": container with ID starting with a28513cd6a754e5a91ddbc55442d91504419cf3a74f2654e641888fceee6b65e not found: ID does not exist" Jul 01 16:11:48.343612 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.343611 2564 scope.go:117] "RemoveContainer" containerID="5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218" Jul 01 16:11:48.343833 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.343817 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218"} err="failed to get container status \"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218\": rpc error: code = NotFound desc = could not find container \"5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218\": container with ID starting with 5d769445f9ed32839cce5b9b0dcbdf7f3f0f989df31a46efb7363d4ae51bc218 not found: ID does not exist" Jul 01 16:11:48.343878 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.343835 2564 scope.go:117] "RemoveContainer" containerID="8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960" Jul 01 16:11:48.344018 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.344003 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960"} err="failed to get container status \"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960\": rpc error: code = NotFound desc = could not find container \"8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960\": container with ID starting with 8a4b94e7ae7b3aaeb290126cd330e6d6d85698f2176f247f1479927a8f4d7960 not found: ID does not exist" Jul 01 16:11:48.344018 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.344018 2564 scope.go:117] "RemoveContainer" containerID="0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d" Jul 01 16:11:48.344235 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.344207 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d"} err="failed to get container status \"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d\": rpc error: code = NotFound desc = could not find container \"0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d\": container with ID starting with 0e07d03c22d9b6db9d274c65b2b90c0e9ccd4d35590ea93ec806da7c40f72e5d not found: ID does not exist" Jul 01 16:11:48.344235 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.344227 2564 scope.go:117] "RemoveContainer" containerID="da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a" Jul 01 16:11:48.344411 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.344396 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a"} err="failed to get container status \"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a\": rpc error: code = NotFound desc = could not find container \"da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a\": container with ID starting with da400e3224ec85edb1ff8225841e2efc2cdea908363492b21acf3a1cd1680b2a not found: ID does not exist" Jul 01 16:11:48.344453 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.344412 2564 scope.go:117] "RemoveContainer" containerID="0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7" Jul 01 16:11:48.344601 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.344586 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7"} err="failed to get container status \"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7\": rpc error: code = NotFound desc = could not find container \"0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7\": container with ID starting with 0fe0520a7660aacc35f70a836b4a215cd62bb3e8bf348edbbde9b4643d6ef3c7 not found: ID does not exist" Jul 01 16:11:48.344643 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.344602 2564 scope.go:117] "RemoveContainer" containerID="ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace" Jul 01 16:11:48.344768 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.344752 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace"} err="failed to get container status \"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace\": rpc error: code = NotFound desc = could not find container \"ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace\": container with ID starting with ce45a3a9a5cf020d5886c598c669dedf4e4253f644f27b9dd4738b63f0503ace not found: ID does not exist" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.349347 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.349994 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="config-reloader" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350012 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="config-reloader" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350026 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="kube-rbac-proxy-web" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350035 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="kube-rbac-proxy-web" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350057 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="init-config-reloader" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350065 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="init-config-reloader" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350093 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="prometheus" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350101 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="prometheus" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350112 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="thanos-sidecar" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350120 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="thanos-sidecar" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350129 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="kube-rbac-proxy-thanos" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350143 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="kube-rbac-proxy-thanos" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350176 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="kube-rbac-proxy" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350184 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="kube-rbac-proxy" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350298 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="kube-rbac-proxy-thanos" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350316 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="config-reloader" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350325 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="thanos-sidecar" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350342 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="prometheus" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350349 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="kube-rbac-proxy-web" Jul 01 16:11:48.354027 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.350357 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" containerName="kube-rbac-proxy" Jul 01 16:11:48.357685 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.357654 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.361966 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.361942 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 16:11:48.362808 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.362744 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37a25bbf-aed8-47c8-8169-b09decf8995c" path="/var/lib/kubelet/pods/37a25bbf-aed8-47c8-8169-b09decf8995c/volumes" Jul 01 16:11:48.362929 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.362835 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 16:11:48.362929 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.362841 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 16:11:48.362929 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.362866 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 16:11:48.363187 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.363170 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 16:11:48.363240 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.363187 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 16:11:48.363464 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.363446 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 16:11:48.363540 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.363463 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 16:11:48.363994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.363810 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 16:11:48.363994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.363818 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 16:11:48.363994 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.363843 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-em07j1thnk76h\"" Jul 01 16:11:48.364746 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.364730 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 16:11:48.365354 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.365311 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vxqvd\"" Jul 01 16:11:48.365354 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.365345 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 16:11:48.366921 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.366901 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 16:11:48.369105 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.369090 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 16:11:48.373610 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.373591 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:11:48.534134 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534056 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534134 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534089 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534134 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534109 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534337 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534155 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zkdh\" (UniqueName: \"kubernetes.io/projected/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-kube-api-access-8zkdh\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534337 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534171 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534337 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534185 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534337 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534214 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534337 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534228 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534337 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534252 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-web-config\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534337 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534267 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-config\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534337 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534313 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534337 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534329 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534628 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534342 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534628 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534628 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534378 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534628 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534392 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534628 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534407 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534628 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534444 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534628 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534472 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.534628 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.534497 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-config-out\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.635504 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.635466 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.635610 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.635506 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.635610 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.635558 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.635610 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.635597 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zkdh\" (UniqueName: \"kubernetes.io/projected/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-kube-api-access-8zkdh\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.635826 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.635627 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.635826 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.635761 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.635931 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.635850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.635931 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.635887 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.636023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.635933 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-web-config\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.636023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.635963 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-config\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.636023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.636001 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.636162 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.636029 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.636162 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.636055 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.636162 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.636078 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.636162 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.636121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.636162 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.636148 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.636386 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.636171 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.636386 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.636212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.636386 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.636238 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.636386 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.636242 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.636386 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.636320 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.636386 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.636364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-config-out\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.638626 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.638594 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.638737 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.638705 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-web-config\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.638820 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.638772 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-config-out\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.638820 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.638809 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.639742 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.639174 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.639742 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.639208 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.639742 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.639249 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-config\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.639742 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.639377 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.639742 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.639650 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.639742 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.639655 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.639742 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.639699 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.639742 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.639707 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.640114 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.639935 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.641311 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.641286 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.641617 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.641601 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.641868 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.641849 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.641910 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.641878 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.645431 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.645408 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zkdh\" (UniqueName: \"kubernetes.io/projected/c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b-kube-api-access-8zkdh\") pod \"prometheus-k8s-0\" (UID: \"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.668364 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.668339 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:11:48.820640 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:48.820561 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 16:11:48.824307 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:11:48.824277 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6bd5a7f_b796_4f94_b4c1_03b4875b5f0b.slice/crio-8407d4da6b8b62d5f40a35331514d6b82482519cc89436a6a3e015239636d54e WatchSource:0}: Error finding container 8407d4da6b8b62d5f40a35331514d6b82482519cc89436a6a3e015239636d54e: Status 404 returned error can't find the container with id 8407d4da6b8b62d5f40a35331514d6b82482519cc89436a6a3e015239636d54e Jul 01 16:11:49.289502 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:49.289471 2564 generic.go:356] "Generic (PLEG): container finished" podID="c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b" containerID="64392dd53d4152bce2df81b0cb26aba1495c6ce02e4a890b5bb835caa5b3265e" exitCode=0 Jul 01 16:11:49.289931 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:49.289569 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b","Type":"ContainerDied","Data":"64392dd53d4152bce2df81b0cb26aba1495c6ce02e4a890b5bb835caa5b3265e"} Jul 01 16:11:49.289931 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:49.289647 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b","Type":"ContainerStarted","Data":"8407d4da6b8b62d5f40a35331514d6b82482519cc89436a6a3e015239636d54e"} Jul 01 16:11:50.296907 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:50.296869 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b","Type":"ContainerStarted","Data":"143ec153a158bcce86c038402b4cb8c2bd540858a86f2afb617b6cb04983f627"} Jul 01 16:11:50.297424 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:50.296965 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b","Type":"ContainerStarted","Data":"ec61c6fa86770ce55e79c9a12814adb771aaa46474d891cbfd29b01449280dd2"} Jul 01 16:11:50.297424 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:50.296992 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b","Type":"ContainerStarted","Data":"d78ca58386c33f4fc2fcb4e00d4eb907d27e450be0f2d4b4ba7196d681ca3fee"} Jul 01 16:11:50.297424 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:50.297024 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b","Type":"ContainerStarted","Data":"e02d4c885a2b97ac7bc9814ccc26ed4558682d9b64f1c22c4fed27fc42a0f949"} Jul 01 16:11:50.297424 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:50.297048 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b","Type":"ContainerStarted","Data":"5373dec90ed95ea3b4d3dcb1b57ac4593a1bed93ba1335e6d7959512bb0191fc"} Jul 01 16:11:50.297424 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:50.297071 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b","Type":"ContainerStarted","Data":"ba91786b9bc69bd2aa7279592c664d3482127450dea4bc3c0a0f9ec68541d0be"} Jul 01 16:11:50.333108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:50.333055 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.314525595 podStartE2EDuration="2.333035426s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.509831ms" isStatefulPod=false podCreationTimestamp="2026-07-01 16:11:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:11:50.330213157 +0000 UTC m=+198.382351153" watchObservedRunningTime="2026-07-01 16:11:50.333035426 +0000 UTC m=+198.385173420" Jul 01 16:11:53.669514 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:11:53.669463 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:12:48.668792 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:12:48.668737 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:12:48.684232 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:12:48.684206 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:12:49.532688 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:12:49.532659 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 16:13:32.288416 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:13:32.288388 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6vrq_d23ea488-6e17-4aa2-969e-f1ac3b448006/ovn-acl-logging/0.log" Jul 01 16:13:32.292750 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:13:32.292725 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6vrq_d23ea488-6e17-4aa2-969e-f1ac3b448006/ovn-acl-logging/0.log" Jul 01 16:13:32.293564 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:13:32.293548 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 16:15:05.399106 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.399024 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w"] Jul 01 16:15:05.402491 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.402473 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:05.406282 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.406255 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 16:15:05.406405 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.406265 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 16:15:05.406902 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.406882 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 16:15:05.407274 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.407253 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 16:15:05.408038 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.408021 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4vx4q\"" Jul 01 16:15:05.431509 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.431480 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w"] Jul 01 16:15:05.528503 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.528457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwmjj\" (UniqueName: \"kubernetes.io/projected/1fbeaf5e-0126-443a-a86a-9578f842395d-kube-api-access-cwmjj\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w\" (UID: \"1fbeaf5e-0126-443a-a86a-9578f842395d\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:05.528704 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.528516 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1fbeaf5e-0126-443a-a86a-9578f842395d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w\" (UID: \"1fbeaf5e-0126-443a-a86a-9578f842395d\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:05.528704 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.528585 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fbeaf5e-0126-443a-a86a-9578f842395d-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w\" (UID: \"1fbeaf5e-0126-443a-a86a-9578f842395d\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:05.528850 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.528704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1fbeaf5e-0126-443a-a86a-9578f842395d-manifests\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w\" (UID: \"1fbeaf5e-0126-443a-a86a-9578f842395d\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:05.528850 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.528730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fbeaf5e-0126-443a-a86a-9578f842395d-tmp\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w\" (UID: \"1fbeaf5e-0126-443a-a86a-9578f842395d\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:05.630154 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.630116 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1fbeaf5e-0126-443a-a86a-9578f842395d-manifests\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w\" (UID: \"1fbeaf5e-0126-443a-a86a-9578f842395d\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:05.630154 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.630152 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fbeaf5e-0126-443a-a86a-9578f842395d-tmp\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w\" (UID: \"1fbeaf5e-0126-443a-a86a-9578f842395d\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:05.630411 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.630183 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwmjj\" (UniqueName: \"kubernetes.io/projected/1fbeaf5e-0126-443a-a86a-9578f842395d-kube-api-access-cwmjj\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w\" (UID: \"1fbeaf5e-0126-443a-a86a-9578f842395d\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:05.630411 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.630211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1fbeaf5e-0126-443a-a86a-9578f842395d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w\" (UID: \"1fbeaf5e-0126-443a-a86a-9578f842395d\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:05.630411 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.630228 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fbeaf5e-0126-443a-a86a-9578f842395d-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w\" (UID: \"1fbeaf5e-0126-443a-a86a-9578f842395d\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:05.630623 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.630592 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1fbeaf5e-0126-443a-a86a-9578f842395d-manifests\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w\" (UID: \"1fbeaf5e-0126-443a-a86a-9578f842395d\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:05.632647 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.632611 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1fbeaf5e-0126-443a-a86a-9578f842395d-tmp\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w\" (UID: \"1fbeaf5e-0126-443a-a86a-9578f842395d\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:05.632767 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.632755 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1fbeaf5e-0126-443a-a86a-9578f842395d-webhook-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w\" (UID: \"1fbeaf5e-0126-443a-a86a-9578f842395d\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:05.632863 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.632753 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1fbeaf5e-0126-443a-a86a-9578f842395d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w\" (UID: \"1fbeaf5e-0126-443a-a86a-9578f842395d\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:05.652983 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.652919 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwmjj\" (UniqueName: \"kubernetes.io/projected/1fbeaf5e-0126-443a-a86a-9578f842395d-kube-api-access-cwmjj\") pod \"opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w\" (UID: \"1fbeaf5e-0126-443a-a86a-9578f842395d\") " pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:05.712612 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.712572 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:05.903889 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:15:05.903830 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fbeaf5e_0126_443a_a86a_9578f842395d.slice/crio-1f86291052367f892a7157c1b141186572f4e0eb34c0da8bfa6b1e3354024117 WatchSource:0}: Error finding container 1f86291052367f892a7157c1b141186572f4e0eb34c0da8bfa6b1e3354024117: Status 404 returned error can't find the container with id 1f86291052367f892a7157c1b141186572f4e0eb34c0da8bfa6b1e3354024117 Jul 01 16:15:05.904955 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.904930 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w"] Jul 01 16:15:05.905638 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:05.905623 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:15:06.037515 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.037479 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" event={"ID":"1fbeaf5e-0126-443a-a86a-9578f842395d","Type":"ContainerStarted","Data":"1f86291052367f892a7157c1b141186572f4e0eb34c0da8bfa6b1e3354024117"} Jul 01 16:15:06.052219 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.052189 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7"] Jul 01 16:15:06.056584 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.056564 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" Jul 01 16:15:06.060438 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.060409 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 01 16:15:06.060574 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.060491 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 16:15:06.060638 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.060592 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 01 16:15:06.060638 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.060609 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 16:15:06.060730 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.060664 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hpkn9\"" Jul 01 16:15:06.060730 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.060666 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 01 16:15:06.078192 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.078161 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7"] Jul 01 16:15:06.234667 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.234632 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85q9j\" (UniqueName: \"kubernetes.io/projected/e58f617c-2384-44c9-b6d7-379ebdaf5d79-kube-api-access-85q9j\") pod \"lws-controller-manager-69bb744ddb-578d7\" (UID: \"e58f617c-2384-44c9-b6d7-379ebdaf5d79\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" Jul 01 16:15:06.234865 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.234678 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e58f617c-2384-44c9-b6d7-379ebdaf5d79-cert\") pod \"lws-controller-manager-69bb744ddb-578d7\" (UID: \"e58f617c-2384-44c9-b6d7-379ebdaf5d79\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" Jul 01 16:15:06.234865 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.234724 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e58f617c-2384-44c9-b6d7-379ebdaf5d79-manager-config\") pod \"lws-controller-manager-69bb744ddb-578d7\" (UID: \"e58f617c-2384-44c9-b6d7-379ebdaf5d79\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" Jul 01 16:15:06.234865 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.234750 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e58f617c-2384-44c9-b6d7-379ebdaf5d79-metrics-cert\") pod \"lws-controller-manager-69bb744ddb-578d7\" (UID: \"e58f617c-2384-44c9-b6d7-379ebdaf5d79\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" Jul 01 16:15:06.335535 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.335496 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85q9j\" (UniqueName: \"kubernetes.io/projected/e58f617c-2384-44c9-b6d7-379ebdaf5d79-kube-api-access-85q9j\") pod \"lws-controller-manager-69bb744ddb-578d7\" (UID: \"e58f617c-2384-44c9-b6d7-379ebdaf5d79\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" Jul 01 16:15:06.335535 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.335536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e58f617c-2384-44c9-b6d7-379ebdaf5d79-cert\") pod \"lws-controller-manager-69bb744ddb-578d7\" (UID: \"e58f617c-2384-44c9-b6d7-379ebdaf5d79\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" Jul 01 16:15:06.335742 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.335573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e58f617c-2384-44c9-b6d7-379ebdaf5d79-manager-config\") pod \"lws-controller-manager-69bb744ddb-578d7\" (UID: \"e58f617c-2384-44c9-b6d7-379ebdaf5d79\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" Jul 01 16:15:06.335742 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.335596 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e58f617c-2384-44c9-b6d7-379ebdaf5d79-metrics-cert\") pod \"lws-controller-manager-69bb744ddb-578d7\" (UID: \"e58f617c-2384-44c9-b6d7-379ebdaf5d79\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" Jul 01 16:15:06.336266 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.336245 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e58f617c-2384-44c9-b6d7-379ebdaf5d79-manager-config\") pod \"lws-controller-manager-69bb744ddb-578d7\" (UID: \"e58f617c-2384-44c9-b6d7-379ebdaf5d79\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" Jul 01 16:15:06.338029 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.338001 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e58f617c-2384-44c9-b6d7-379ebdaf5d79-metrics-cert\") pod \"lws-controller-manager-69bb744ddb-578d7\" (UID: \"e58f617c-2384-44c9-b6d7-379ebdaf5d79\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" Jul 01 16:15:06.338124 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.338068 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e58f617c-2384-44c9-b6d7-379ebdaf5d79-cert\") pod \"lws-controller-manager-69bb744ddb-578d7\" (UID: \"e58f617c-2384-44c9-b6d7-379ebdaf5d79\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" Jul 01 16:15:06.430222 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.430184 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85q9j\" (UniqueName: \"kubernetes.io/projected/e58f617c-2384-44c9-b6d7-379ebdaf5d79-kube-api-access-85q9j\") pod \"lws-controller-manager-69bb744ddb-578d7\" (UID: \"e58f617c-2384-44c9-b6d7-379ebdaf5d79\") " pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" Jul 01 16:15:06.666350 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.666252 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" Jul 01 16:15:06.850907 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:06.850844 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7"] Jul 01 16:15:06.854887 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:15:06.854855 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode58f617c_2384_44c9_b6d7_379ebdaf5d79.slice/crio-baceed0bf3b8f393ee8cbc8bd02a022de04ffdedd590822e608296e44a4ac213 WatchSource:0}: Error finding container baceed0bf3b8f393ee8cbc8bd02a022de04ffdedd590822e608296e44a4ac213: Status 404 returned error can't find the container with id baceed0bf3b8f393ee8cbc8bd02a022de04ffdedd590822e608296e44a4ac213 Jul 01 16:15:07.043182 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:07.043138 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" event={"ID":"e58f617c-2384-44c9-b6d7-379ebdaf5d79","Type":"ContainerStarted","Data":"baceed0bf3b8f393ee8cbc8bd02a022de04ffdedd590822e608296e44a4ac213"} Jul 01 16:15:11.063536 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:11.063492 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" event={"ID":"e58f617c-2384-44c9-b6d7-379ebdaf5d79","Type":"ContainerStarted","Data":"720071a90f52253ead8eaa24a9746c21800d6a70a387d238adcd07aabd3ed4fd"} Jul 01 16:15:11.064072 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:11.063587 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" Jul 01 16:15:11.064982 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:11.064960 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" event={"ID":"1fbeaf5e-0126-443a-a86a-9578f842395d","Type":"ContainerStarted","Data":"f734e43f25e6e0720337599fa693dfca7d0be3d9e3fc1771da119e8034e5ee75"} Jul 01 16:15:11.166179 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:11.166082 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" podStartSLOduration=1.820621927 podStartE2EDuration="5.16606354s" totalImagesPullingTime="3.345441613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:15:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:15:11.113018007 +0000 UTC m=+399.165156000" watchObservedRunningTime="2026-07-01 16:15:11.16606354 +0000 UTC m=+399.218201533" Jul 01 16:15:12.072580 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:12.072538 2564 generic.go:356] "Generic (PLEG): container finished" podID="1fbeaf5e-0126-443a-a86a-9578f842395d" containerID="f734e43f25e6e0720337599fa693dfca7d0be3d9e3fc1771da119e8034e5ee75" exitCode=0 Jul 01 16:15:12.073086 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:12.072622 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" event={"ID":"1fbeaf5e-0126-443a-a86a-9578f842395d","Type":"ContainerDied","Data":"f734e43f25e6e0720337599fa693dfca7d0be3d9e3fc1771da119e8034e5ee75"} Jul 01 16:15:13.079790 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:13.079738 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" event={"ID":"1fbeaf5e-0126-443a-a86a-9578f842395d","Type":"ContainerStarted","Data":"8d1eeca8563d4af72449ad91669dbae20be24f24bee9a9ea3f70b7253185c24a"} Jul 01 16:15:13.080198 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:13.079862 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:22.075331 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:22.075282 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-69bb744ddb-578d7" Jul 01 16:15:22.107431 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:22.107382 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" podStartSLOduration=11.360550285 podStartE2EDuration="17.107364557s" totalImagesPullingTime="4.738418858s" totalInitContainerRuntime="1.008395414s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:15:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:15:13.181060721 +0000 UTC m=+401.233198727" watchObservedRunningTime="2026-07-01 16:15:22.107364557 +0000 UTC m=+410.159502551" Jul 01 16:15:24.087516 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:24.087481 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w" Jul 01 16:15:32.439473 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:32.439438 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5545fb4b4d-j7955"] Jul 01 16:15:32.444418 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:32.444394 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-j7955" Jul 01 16:15:32.453938 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:32.453905 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 01 16:15:32.454110 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:32.453975 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pqv8m\"" Jul 01 16:15:32.454110 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:32.453977 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 01 16:15:32.467216 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:32.467189 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5545fb4b4d-j7955"] Jul 01 16:15:32.568579 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:32.568546 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmjwd\" (UniqueName: \"kubernetes.io/projected/b8587130-6895-4d12-9c7c-04d7f4c1de74-kube-api-access-tmjwd\") pod \"kube-auth-proxy-5545fb4b4d-j7955\" (UID: \"b8587130-6895-4d12-9c7c-04d7f4c1de74\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-j7955" Jul 01 16:15:32.568741 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:32.568599 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8587130-6895-4d12-9c7c-04d7f4c1de74-tls-certs\") pod \"kube-auth-proxy-5545fb4b4d-j7955\" (UID: \"b8587130-6895-4d12-9c7c-04d7f4c1de74\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-j7955" Jul 01 16:15:32.568741 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:32.568694 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8587130-6895-4d12-9c7c-04d7f4c1de74-tmp\") pod \"kube-auth-proxy-5545fb4b4d-j7955\" (UID: \"b8587130-6895-4d12-9c7c-04d7f4c1de74\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-j7955" Jul 01 16:15:32.669837 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:32.669793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8587130-6895-4d12-9c7c-04d7f4c1de74-tmp\") pod \"kube-auth-proxy-5545fb4b4d-j7955\" (UID: \"b8587130-6895-4d12-9c7c-04d7f4c1de74\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-j7955" Jul 01 16:15:32.670009 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:32.669853 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmjwd\" (UniqueName: \"kubernetes.io/projected/b8587130-6895-4d12-9c7c-04d7f4c1de74-kube-api-access-tmjwd\") pod \"kube-auth-proxy-5545fb4b4d-j7955\" (UID: \"b8587130-6895-4d12-9c7c-04d7f4c1de74\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-j7955" Jul 01 16:15:32.670009 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:32.669892 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8587130-6895-4d12-9c7c-04d7f4c1de74-tls-certs\") pod \"kube-auth-proxy-5545fb4b4d-j7955\" (UID: \"b8587130-6895-4d12-9c7c-04d7f4c1de74\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-j7955" Jul 01 16:15:32.672155 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:32.672127 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8587130-6895-4d12-9c7c-04d7f4c1de74-tmp\") pod \"kube-auth-proxy-5545fb4b4d-j7955\" (UID: \"b8587130-6895-4d12-9c7c-04d7f4c1de74\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-j7955" Jul 01 16:15:32.672275 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:32.672259 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8587130-6895-4d12-9c7c-04d7f4c1de74-tls-certs\") pod \"kube-auth-proxy-5545fb4b4d-j7955\" (UID: \"b8587130-6895-4d12-9c7c-04d7f4c1de74\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-j7955" Jul 01 16:15:32.692902 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:32.692841 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmjwd\" (UniqueName: \"kubernetes.io/projected/b8587130-6895-4d12-9c7c-04d7f4c1de74-kube-api-access-tmjwd\") pod \"kube-auth-proxy-5545fb4b4d-j7955\" (UID: \"b8587130-6895-4d12-9c7c-04d7f4c1de74\") " pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-j7955" Jul 01 16:15:32.762209 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:32.762171 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-j7955" Jul 01 16:15:32.896858 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:32.896820 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5545fb4b4d-j7955"] Jul 01 16:15:32.898935 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:15:32.898905 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8587130_6895_4d12_9c7c_04d7f4c1de74.slice/crio-e12ee1cf0e50b94160cc8c8b758a9365cf6968ac7a11f50e10b6ee347ebb5f0f WatchSource:0}: Error finding container e12ee1cf0e50b94160cc8c8b758a9365cf6968ac7a11f50e10b6ee347ebb5f0f: Status 404 returned error can't find the container with id e12ee1cf0e50b94160cc8c8b758a9365cf6968ac7a11f50e10b6ee347ebb5f0f Jul 01 16:15:33.163531 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:33.163489 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-j7955" event={"ID":"b8587130-6895-4d12-9c7c-04d7f4c1de74","Type":"ContainerStarted","Data":"e12ee1cf0e50b94160cc8c8b758a9365cf6968ac7a11f50e10b6ee347ebb5f0f"} Jul 01 16:15:36.182161 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:36.182070 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-j7955" event={"ID":"b8587130-6895-4d12-9c7c-04d7f4c1de74","Type":"ContainerStarted","Data":"cb3799441b9a25f1c77e915861c435d08b81dc0a87c901750e58551a126f690f"} Jul 01 16:15:36.206067 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:15:36.206013 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5545fb4b4d-j7955" podStartSLOduration=1.20866446 podStartE2EDuration="4.205994433s" totalImagesPullingTime="2.997329973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:15:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:15:36.203873469 +0000 UTC m=+424.256011462" watchObservedRunningTime="2026-07-01 16:15:36.205994433 +0000 UTC m=+424.258132425" Jul 01 16:17:32.630982 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:32.630903 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9gk"] Jul 01 16:17:32.634312 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:32.634290 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9gk" Jul 01 16:17:32.640038 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:32.640012 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 01 16:17:32.640038 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:32.640012 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-n4mjr\"" Jul 01 16:17:32.640225 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:32.640060 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 16:17:32.641151 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:32.641128 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 16:17:32.657534 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:32.657505 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9gk"] Jul 01 16:17:32.812961 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:32.812926 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7pj2\" (UniqueName: \"kubernetes.io/projected/5f23d175-d989-48b1-a711-747238df3c00-kube-api-access-t7pj2\") pod \"dns-operator-controller-manager-864dd78c4c-fz9gk\" (UID: \"5f23d175-d989-48b1-a711-747238df3c00\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9gk" Jul 01 16:17:32.914342 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:32.914247 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7pj2\" (UniqueName: \"kubernetes.io/projected/5f23d175-d989-48b1-a711-747238df3c00-kube-api-access-t7pj2\") pod \"dns-operator-controller-manager-864dd78c4c-fz9gk\" (UID: \"5f23d175-d989-48b1-a711-747238df3c00\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9gk" Jul 01 16:17:32.929242 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:32.929211 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7pj2\" (UniqueName: \"kubernetes.io/projected/5f23d175-d989-48b1-a711-747238df3c00-kube-api-access-t7pj2\") pod \"dns-operator-controller-manager-864dd78c4c-fz9gk\" (UID: \"5f23d175-d989-48b1-a711-747238df3c00\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9gk" Jul 01 16:17:32.944013 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:32.943984 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9gk" Jul 01 16:17:33.087816 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:33.087791 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9gk"] Jul 01 16:17:33.089679 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:17:33.089655 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f23d175_d989_48b1_a711_747238df3c00.slice/crio-6d814667c7d3a6f21f85561a33fdedb7484ef67ab0ac0be0574b699bf907f1e3 WatchSource:0}: Error finding container 6d814667c7d3a6f21f85561a33fdedb7484ef67ab0ac0be0574b699bf907f1e3: Status 404 returned error can't find the container with id 6d814667c7d3a6f21f85561a33fdedb7484ef67ab0ac0be0574b699bf907f1e3 Jul 01 16:17:33.679158 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:33.679122 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9gk" event={"ID":"5f23d175-d989-48b1-a711-747238df3c00","Type":"ContainerStarted","Data":"6d814667c7d3a6f21f85561a33fdedb7484ef67ab0ac0be0574b699bf907f1e3"} Jul 01 16:17:35.689892 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:35.689853 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9gk" event={"ID":"5f23d175-d989-48b1-a711-747238df3c00","Type":"ContainerStarted","Data":"227347be29a2e7dd9218aac4d6d5de7e77fcd34f35d668ae72765762a2d1082f"} Jul 01 16:17:35.690351 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:35.689924 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9gk" Jul 01 16:17:35.710629 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:35.710580 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9gk" podStartSLOduration=1.7471518320000001 podStartE2EDuration="3.710563171s" totalImagesPullingTime="1.963411339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:17:35.71009323 +0000 UTC m=+543.762231256" watchObservedRunningTime="2026-07-01 16:17:35.710563171 +0000 UTC m=+543.762701164" Jul 01 16:17:38.800101 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:38.800065 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv"] Jul 01 16:17:38.803392 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:38.803377 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv" Jul 01 16:17:38.806661 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:38.806642 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cp5ln\"" Jul 01 16:17:38.806820 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:38.806703 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 01 16:17:38.806820 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:38.806736 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 01 16:17:38.814885 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:38.814866 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv"] Jul 01 16:17:38.859471 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:38.859440 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a1010cd-3316-419d-9151-c9696099b523-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2qpcv\" (UID: \"2a1010cd-3316-419d-9151-c9696099b523\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv" Jul 01 16:17:38.859471 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:38.859474 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gkjj\" (UniqueName: \"kubernetes.io/projected/2a1010cd-3316-419d-9151-c9696099b523-kube-api-access-5gkjj\") pod \"kuadrant-console-plugin-66b5774985-2qpcv\" (UID: \"2a1010cd-3316-419d-9151-c9696099b523\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv" Jul 01 16:17:38.859665 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:38.859588 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2a1010cd-3316-419d-9151-c9696099b523-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2qpcv\" (UID: \"2a1010cd-3316-419d-9151-c9696099b523\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv" Jul 01 16:17:38.960841 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:38.960804 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gkjj\" (UniqueName: \"kubernetes.io/projected/2a1010cd-3316-419d-9151-c9696099b523-kube-api-access-5gkjj\") pod \"kuadrant-console-plugin-66b5774985-2qpcv\" (UID: \"2a1010cd-3316-419d-9151-c9696099b523\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv" Jul 01 16:17:38.961002 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:38.960912 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2a1010cd-3316-419d-9151-c9696099b523-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2qpcv\" (UID: \"2a1010cd-3316-419d-9151-c9696099b523\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv" Jul 01 16:17:38.961002 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:38.960947 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a1010cd-3316-419d-9151-c9696099b523-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2qpcv\" (UID: \"2a1010cd-3316-419d-9151-c9696099b523\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv" Jul 01 16:17:38.961070 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:17:38.961029 2564 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 01 16:17:38.961112 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:17:38.961092 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a1010cd-3316-419d-9151-c9696099b523-plugin-serving-cert podName:2a1010cd-3316-419d-9151-c9696099b523 nodeName:}" failed. No retries permitted until 2026-07-01 16:17:39.461066539 +0000 UTC m=+547.513204511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/2a1010cd-3316-419d-9151-c9696099b523-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-2qpcv" (UID: "2a1010cd-3316-419d-9151-c9696099b523") : secret "plugin-serving-cert" not found Jul 01 16:17:38.961566 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:38.961544 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2a1010cd-3316-419d-9151-c9696099b523-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-2qpcv\" (UID: \"2a1010cd-3316-419d-9151-c9696099b523\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv" Jul 01 16:17:38.973159 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:38.973126 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gkjj\" (UniqueName: \"kubernetes.io/projected/2a1010cd-3316-419d-9151-c9696099b523-kube-api-access-5gkjj\") pod \"kuadrant-console-plugin-66b5774985-2qpcv\" (UID: \"2a1010cd-3316-419d-9151-c9696099b523\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv" Jul 01 16:17:39.464540 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:39.464501 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a1010cd-3316-419d-9151-c9696099b523-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2qpcv\" (UID: \"2a1010cd-3316-419d-9151-c9696099b523\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv" Jul 01 16:17:39.466979 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:39.466957 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a1010cd-3316-419d-9151-c9696099b523-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-2qpcv\" (UID: \"2a1010cd-3316-419d-9151-c9696099b523\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv" Jul 01 16:17:39.725561 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:39.725467 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv" Jul 01 16:17:39.861549 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:39.861502 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv"] Jul 01 16:17:39.863679 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:17:39.863653 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a1010cd_3316_419d_9151_c9696099b523.slice/crio-c0286f3af681d56c5937a9533921af36c9e956a3388af5a71939973a3e80c2b9 WatchSource:0}: Error finding container c0286f3af681d56c5937a9533921af36c9e956a3388af5a71939973a3e80c2b9: Status 404 returned error can't find the container with id c0286f3af681d56c5937a9533921af36c9e956a3388af5a71939973a3e80c2b9 Jul 01 16:17:40.712839 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:40.712803 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv" event={"ID":"2a1010cd-3316-419d-9151-c9696099b523","Type":"ContainerStarted","Data":"c0286f3af681d56c5937a9533921af36c9e956a3388af5a71939973a3e80c2b9"} Jul 01 16:17:46.697250 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:17:46.697218 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fz9gk" Jul 01 16:18:04.838090 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:04.837999 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv" event={"ID":"2a1010cd-3316-419d-9151-c9696099b523","Type":"ContainerStarted","Data":"9adf50b1878a1edb911d5f64588867874d2fdebbca240b3818eade7166bd6707"} Jul 01 16:18:04.861301 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:04.861236 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-2qpcv" podStartSLOduration=2.204768362 podStartE2EDuration="26.861221159s" totalImagesPullingTime="24.656452797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:18:04.859497047 +0000 UTC m=+572.911635042" watchObservedRunningTime="2026-07-01 16:18:04.861221159 +0000 UTC m=+572.913359153" Jul 01 16:18:32.317140 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:32.317112 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6vrq_d23ea488-6e17-4aa2-969e-f1ac3b448006/ovn-acl-logging/0.log" Jul 01 16:18:32.319518 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:32.319495 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6vrq_d23ea488-6e17-4aa2-969e-f1ac3b448006/ovn-acl-logging/0.log" Jul 01 16:18:33.825355 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:33.825312 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zgg88"] Jul 01 16:18:33.866827 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:33.866797 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zgg88"] Jul 01 16:18:33.866827 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:33.866834 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zgg88"] Jul 01 16:18:33.867037 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:33.866906 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-zgg88" Jul 01 16:18:33.869764 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:33.869743 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 01 16:18:33.967322 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:33.967280 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dcc3aef6-add2-489e-916f-ee120c808c5b-config-file\") pod \"limitador-limitador-54d6d988d5-zgg88\" (UID: \"dcc3aef6-add2-489e-916f-ee120c808c5b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zgg88" Jul 01 16:18:33.967322 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:33.967322 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdf5k\" (UniqueName: \"kubernetes.io/projected/dcc3aef6-add2-489e-916f-ee120c808c5b-kube-api-access-zdf5k\") pod \"limitador-limitador-54d6d988d5-zgg88\" (UID: \"dcc3aef6-add2-489e-916f-ee120c808c5b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zgg88" Jul 01 16:18:34.068401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:34.068357 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dcc3aef6-add2-489e-916f-ee120c808c5b-config-file\") pod \"limitador-limitador-54d6d988d5-zgg88\" (UID: \"dcc3aef6-add2-489e-916f-ee120c808c5b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zgg88" Jul 01 16:18:34.068401 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:34.068404 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdf5k\" (UniqueName: \"kubernetes.io/projected/dcc3aef6-add2-489e-916f-ee120c808c5b-kube-api-access-zdf5k\") pod \"limitador-limitador-54d6d988d5-zgg88\" (UID: \"dcc3aef6-add2-489e-916f-ee120c808c5b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zgg88" Jul 01 16:18:34.069098 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:34.069069 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/dcc3aef6-add2-489e-916f-ee120c808c5b-config-file\") pod \"limitador-limitador-54d6d988d5-zgg88\" (UID: \"dcc3aef6-add2-489e-916f-ee120c808c5b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zgg88" Jul 01 16:18:34.078442 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:34.078374 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdf5k\" (UniqueName: \"kubernetes.io/projected/dcc3aef6-add2-489e-916f-ee120c808c5b-kube-api-access-zdf5k\") pod \"limitador-limitador-54d6d988d5-zgg88\" (UID: \"dcc3aef6-add2-489e-916f-ee120c808c5b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zgg88" Jul 01 16:18:34.177197 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:34.177153 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-zgg88" Jul 01 16:18:34.312643 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:34.312619 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zgg88"] Jul 01 16:18:34.314487 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:18:34.314458 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc3aef6_add2_489e_916f_ee120c808c5b.slice/crio-7366966b7125bd580da3316e6dad5ea92f3aaba572a30fb9d6fc15b364337b9f WatchSource:0}: Error finding container 7366966b7125bd580da3316e6dad5ea92f3aaba572a30fb9d6fc15b364337b9f: Status 404 returned error can't find the container with id 7366966b7125bd580da3316e6dad5ea92f3aaba572a30fb9d6fc15b364337b9f Jul 01 16:18:34.974555 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:34.974469 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-zgg88" event={"ID":"dcc3aef6-add2-489e-916f-ee120c808c5b","Type":"ContainerStarted","Data":"7366966b7125bd580da3316e6dad5ea92f3aaba572a30fb9d6fc15b364337b9f"} Jul 01 16:18:37.991677 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:37.991635 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-zgg88" event={"ID":"dcc3aef6-add2-489e-916f-ee120c808c5b","Type":"ContainerStarted","Data":"338abea7c3e329f8f62b6816b3f4c70b248209473828da599e81f0c0c2d54acd"} Jul 01 16:18:37.992172 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:37.991713 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-zgg88" Jul 01 16:18:38.012195 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:38.012140 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-zgg88" podStartSLOduration=2.124799847 podStartE2EDuration="5.012126453s" totalImagesPullingTime="2.887326606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:18:38.010771952 +0000 UTC m=+606.062909946" watchObservedRunningTime="2026-07-01 16:18:38.012126453 +0000 UTC m=+606.064264445" Jul 01 16:18:48.998244 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:18:48.998207 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-zgg88" Jul 01 16:19:25.706301 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:25.706270 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:19:25.709953 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:25.709933 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 16:19:25.713233 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:25.713203 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 16:19:25.713371 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:25.713203 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-lg5m9\"" Jul 01 16:19:25.714196 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:25.714176 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 01 16:19:25.714334 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:25.714234 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 16:19:25.722120 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:25.722100 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:19:25.846054 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:25.846010 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzhpg\" (UniqueName: \"kubernetes.io/projected/6446a6b1-24b3-487c-9cd2-1d706afc3c08-kube-api-access-gzhpg\") pod \"maas-keycloak-0\" (UID: \"6446a6b1-24b3-487c-9cd2-1d706afc3c08\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:19:25.946999 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:25.946960 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzhpg\" (UniqueName: \"kubernetes.io/projected/6446a6b1-24b3-487c-9cd2-1d706afc3c08-kube-api-access-gzhpg\") pod \"maas-keycloak-0\" (UID: \"6446a6b1-24b3-487c-9cd2-1d706afc3c08\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:19:25.957529 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:25.957473 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzhpg\" (UniqueName: \"kubernetes.io/projected/6446a6b1-24b3-487c-9cd2-1d706afc3c08-kube-api-access-gzhpg\") pod \"maas-keycloak-0\" (UID: \"6446a6b1-24b3-487c-9cd2-1d706afc3c08\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:19:26.019199 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:26.019160 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 16:19:26.156595 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:26.156572 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:19:26.158471 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:19:26.158444 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6446a6b1_24b3_487c_9cd2_1d706afc3c08.slice/crio-5a3c187fafcfd5c5706e3c28876515db45516fd7392c294980d459d7f41bb908 WatchSource:0}: Error finding container 5a3c187fafcfd5c5706e3c28876515db45516fd7392c294980d459d7f41bb908: Status 404 returned error can't find the container with id 5a3c187fafcfd5c5706e3c28876515db45516fd7392c294980d459d7f41bb908 Jul 01 16:19:26.201419 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:26.201387 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6446a6b1-24b3-487c-9cd2-1d706afc3c08","Type":"ContainerStarted","Data":"5a3c187fafcfd5c5706e3c28876515db45516fd7392c294980d459d7f41bb908"} Jul 01 16:19:32.234458 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:32.234409 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6446a6b1-24b3-487c-9cd2-1d706afc3c08","Type":"ContainerStarted","Data":"6bb47d6cef7d3d7841bbb828231c6b55577df15975603d34e29e0480f2a5dfb4"} Jul 01 16:19:32.253185 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:32.253126 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.794074729 podStartE2EDuration="7.253105979s" totalImagesPullingTime="5.45903125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:19:32.252490703 +0000 UTC m=+660.304628708" watchObservedRunningTime="2026-07-01 16:19:32.253105979 +0000 UTC m=+660.305243952" Jul 01 16:19:33.020278 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:33.020229 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 01 16:19:33.022300 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:33.022255 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jul 01 16:19:34.020526 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:34.020470 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jul 01 16:19:35.020245 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:35.020198 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jul 01 16:19:36.020756 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:36.020712 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jul 01 16:19:36.021744 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:36.021718 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 01 16:19:37.019957 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:37.019898 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jul 01 16:19:38.019654 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:38.019606 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jul 01 16:19:39.019890 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:39.019840 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jul 01 16:19:40.019584 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:40.019525 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jul 01 16:19:41.020547 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:41.020487 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jul 01 16:19:42.020203 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:42.020147 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jul 01 16:19:43.019989 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:43.019939 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jul 01 16:19:44.019865 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:44.019821 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jul 01 16:19:45.118904 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:45.118868 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 01 16:19:45.137762 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:45.137717 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 16:19:55.125836 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:19:55.125797 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 01 16:20:39.436936 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:39.436705 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zgg88"] Jul 01 16:20:50.469635 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:50.469597 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:20:50.470068 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:50.469808 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerName="keycloak" containerID="cri-o://6bb47d6cef7d3d7841bbb828231c6b55577df15975603d34e29e0480f2a5dfb4" gracePeriod=30 Jul 01 16:20:52.513545 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:52.513516 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 16:20:52.632000 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:52.631966 2564 generic.go:356] "Generic (PLEG): container finished" podID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerID="6bb47d6cef7d3d7841bbb828231c6b55577df15975603d34e29e0480f2a5dfb4" exitCode=143 Jul 01 16:20:52.632185 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:52.632008 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6446a6b1-24b3-487c-9cd2-1d706afc3c08","Type":"ContainerDied","Data":"6bb47d6cef7d3d7841bbb828231c6b55577df15975603d34e29e0480f2a5dfb4"} Jul 01 16:20:52.632185 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:52.632022 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 16:20:52.632185 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:52.632049 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6446a6b1-24b3-487c-9cd2-1d706afc3c08","Type":"ContainerDied","Data":"5a3c187fafcfd5c5706e3c28876515db45516fd7392c294980d459d7f41bb908"} Jul 01 16:20:52.632185 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:52.632074 2564 scope.go:117] "RemoveContainer" containerID="6bb47d6cef7d3d7841bbb828231c6b55577df15975603d34e29e0480f2a5dfb4" Jul 01 16:20:52.632388 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:52.632218 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzhpg\" (UniqueName: \"kubernetes.io/projected/6446a6b1-24b3-487c-9cd2-1d706afc3c08-kube-api-access-gzhpg\") pod \"6446a6b1-24b3-487c-9cd2-1d706afc3c08\" (UID: \"6446a6b1-24b3-487c-9cd2-1d706afc3c08\") " Jul 01 16:20:52.634495 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:52.634445 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6446a6b1-24b3-487c-9cd2-1d706afc3c08-kube-api-access-gzhpg" (OuterVolumeSpecName: "kube-api-access-gzhpg") pod "6446a6b1-24b3-487c-9cd2-1d706afc3c08" (UID: "6446a6b1-24b3-487c-9cd2-1d706afc3c08"). InnerVolumeSpecName "kube-api-access-gzhpg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 16:20:52.647591 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:52.647564 2564 scope.go:117] "RemoveContainer" containerID="6bb47d6cef7d3d7841bbb828231c6b55577df15975603d34e29e0480f2a5dfb4" Jul 01 16:20:52.648020 ip-10-0-136-120 kubenswrapper[2564]: E0701 16:20:52.647995 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bb47d6cef7d3d7841bbb828231c6b55577df15975603d34e29e0480f2a5dfb4\": container with ID starting with 6bb47d6cef7d3d7841bbb828231c6b55577df15975603d34e29e0480f2a5dfb4 not found: ID does not exist" containerID="6bb47d6cef7d3d7841bbb828231c6b55577df15975603d34e29e0480f2a5dfb4" Jul 01 16:20:52.648103 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:52.648032 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bb47d6cef7d3d7841bbb828231c6b55577df15975603d34e29e0480f2a5dfb4"} err="failed to get container status \"6bb47d6cef7d3d7841bbb828231c6b55577df15975603d34e29e0480f2a5dfb4\": rpc error: code = NotFound desc = could not find container \"6bb47d6cef7d3d7841bbb828231c6b55577df15975603d34e29e0480f2a5dfb4\": container with ID starting with 6bb47d6cef7d3d7841bbb828231c6b55577df15975603d34e29e0480f2a5dfb4 not found: ID does not exist" Jul 01 16:20:52.733382 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:52.733353 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzhpg\" (UniqueName: \"kubernetes.io/projected/6446a6b1-24b3-487c-9cd2-1d706afc3c08-kube-api-access-gzhpg\") on node \"ip-10-0-136-120.ec2.internal\" DevicePath \"\"" Jul 01 16:20:52.957062 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:52.957025 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:20:52.964087 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:52.964060 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:20:52.992180 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:52.992151 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:20:52.992524 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:52.992510 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerName="keycloak" Jul 01 16:20:52.992566 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:52.992525 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerName="keycloak" Jul 01 16:20:52.992608 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:52.992572 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" containerName="keycloak" Jul 01 16:20:53.000058 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:53.000021 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 16:20:53.003325 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:53.003291 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jul 01 16:20:53.003491 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:53.003330 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jul 01 16:20:53.003491 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:53.003395 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 01 16:20:53.003948 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:53.003929 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 01 16:20:53.004383 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:53.004358 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-lg5m9\"" Jul 01 16:20:53.006625 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:53.006604 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:20:53.035873 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:53.035832 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c2666035-d6c1-4605-b552-5e0b551a214f-test-realms\") pod \"maas-keycloak-0\" (UID: \"c2666035-d6c1-4605-b552-5e0b551a214f\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:20:53.036047 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:53.035936 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49lcc\" (UniqueName: \"kubernetes.io/projected/c2666035-d6c1-4605-b552-5e0b551a214f-kube-api-access-49lcc\") pod \"maas-keycloak-0\" (UID: \"c2666035-d6c1-4605-b552-5e0b551a214f\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:20:53.137181 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:53.137140 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c2666035-d6c1-4605-b552-5e0b551a214f-test-realms\") pod \"maas-keycloak-0\" (UID: \"c2666035-d6c1-4605-b552-5e0b551a214f\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:20:53.137361 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:53.137230 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49lcc\" (UniqueName: \"kubernetes.io/projected/c2666035-d6c1-4605-b552-5e0b551a214f-kube-api-access-49lcc\") pod \"maas-keycloak-0\" (UID: \"c2666035-d6c1-4605-b552-5e0b551a214f\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:20:53.137892 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:53.137873 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/c2666035-d6c1-4605-b552-5e0b551a214f-test-realms\") pod \"maas-keycloak-0\" (UID: \"c2666035-d6c1-4605-b552-5e0b551a214f\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:20:53.147695 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:53.147671 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49lcc\" (UniqueName: \"kubernetes.io/projected/c2666035-d6c1-4605-b552-5e0b551a214f-kube-api-access-49lcc\") pod \"maas-keycloak-0\" (UID: \"c2666035-d6c1-4605-b552-5e0b551a214f\") " pod="keycloak-system/maas-keycloak-0" Jul 01 16:20:53.311871 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:53.311828 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jul 01 16:20:53.449745 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:53.449722 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jul 01 16:20:53.451549 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:20:53.451526 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2666035_d6c1_4605_b552_5e0b551a214f.slice/crio-651f42b9d3aa36f24c5aa3c8141a6097f62e6dba25fa5763118ece7796cd6a00 WatchSource:0}: Error finding container 651f42b9d3aa36f24c5aa3c8141a6097f62e6dba25fa5763118ece7796cd6a00: Status 404 returned error can't find the container with id 651f42b9d3aa36f24c5aa3c8141a6097f62e6dba25fa5763118ece7796cd6a00 Jul 01 16:20:53.452907 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:53.452888 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 16:20:53.638165 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:53.638077 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c2666035-d6c1-4605-b552-5e0b551a214f","Type":"ContainerStarted","Data":"651f42b9d3aa36f24c5aa3c8141a6097f62e6dba25fa5763118ece7796cd6a00"} Jul 01 16:20:54.360717 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:54.360625 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6446a6b1-24b3-487c-9cd2-1d706afc3c08" path="/var/lib/kubelet/pods/6446a6b1-24b3-487c-9cd2-1d706afc3c08/volumes" Jul 01 16:20:54.646007 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:54.645911 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c2666035-d6c1-4605-b552-5e0b551a214f","Type":"ContainerStarted","Data":"ee41429a07740dfa061111764ba100140307dfb295c871a66735d61719322829"} Jul 01 16:20:54.669343 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:54.669291 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.087617398 podStartE2EDuration="2.669273641s" totalImagesPullingTime="581.656243ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:20:54.666299795 +0000 UTC m=+742.718437789" watchObservedRunningTime="2026-07-01 16:20:54.669273641 +0000 UTC m=+742.721411634" Jul 01 16:20:55.312168 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:55.312123 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jul 01 16:20:55.314041 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:55.313998 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c2666035-d6c1-4605-b552-5e0b551a214f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jul 01 16:20:56.312344 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:56.312288 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c2666035-d6c1-4605-b552-5e0b551a214f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jul 01 16:20:57.313374 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:57.313315 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c2666035-d6c1-4605-b552-5e0b551a214f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jul 01 16:20:58.313264 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:58.313212 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c2666035-d6c1-4605-b552-5e0b551a214f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jul 01 16:20:59.313249 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:20:59.313187 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c2666035-d6c1-4605-b552-5e0b551a214f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jul 01 16:21:00.312904 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:00.312846 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c2666035-d6c1-4605-b552-5e0b551a214f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jul 01 16:21:01.313088 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:01.313032 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c2666035-d6c1-4605-b552-5e0b551a214f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jul 01 16:21:02.312306 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:02.312250 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c2666035-d6c1-4605-b552-5e0b551a214f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jul 01 16:21:03.312799 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:03.312739 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jul 01 16:21:03.313207 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:03.313161 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c2666035-d6c1-4605-b552-5e0b551a214f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jul 01 16:21:04.313263 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:04.313209 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c2666035-d6c1-4605-b552-5e0b551a214f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jul 01 16:21:05.313418 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:05.313359 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c2666035-d6c1-4605-b552-5e0b551a214f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jul 01 16:21:06.312929 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:06.312877 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c2666035-d6c1-4605-b552-5e0b551a214f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jul 01 16:21:07.312998 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:07.312949 2564 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c2666035-d6c1-4605-b552-5e0b551a214f" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.29:9000/health/started\": dial tcp 10.133.0.29:9000: connect: connection refused" Jul 01 16:21:08.433765 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:08.433726 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jul 01 16:21:08.451631 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:08.451580 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c2666035-d6c1-4605-b552-5e0b551a214f" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 16:21:18.439556 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:18.439512 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jul 01 16:21:40.770764 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:40.770717 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zgg88"] Jul 01 16:21:49.994961 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:49.994929 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-z4knl"] Jul 01 16:21:50.000167 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.000149 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:21:50.003486 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.003460 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 16:21:50.003486 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.003460 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 16:21:50.004909 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.004886 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 01 16:21:50.005022 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.004932 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jwztp\"" Jul 01 16:21:50.015285 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.015257 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-z4knl"] Jul 01 16:21:50.099054 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.099019 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/147606e5-001f-48b5-83ec-d4ad6338248f-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-z4knl\" (UID: \"147606e5-001f-48b5-83ec-d4ad6338248f\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:21:50.099229 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.099060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/147606e5-001f-48b5-83ec-d4ad6338248f-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-z4knl\" (UID: \"147606e5-001f-48b5-83ec-d4ad6338248f\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:21:50.099229 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.099188 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/147606e5-001f-48b5-83ec-d4ad6338248f-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-z4knl\" (UID: \"147606e5-001f-48b5-83ec-d4ad6338248f\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:21:50.099299 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.099227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrfbd\" (UniqueName: \"kubernetes.io/projected/147606e5-001f-48b5-83ec-d4ad6338248f-kube-api-access-xrfbd\") pod \"e2e-distinct-simulated-kserve-ff95456df-z4knl\" (UID: \"147606e5-001f-48b5-83ec-d4ad6338248f\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:21:50.099299 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.099249 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/147606e5-001f-48b5-83ec-d4ad6338248f-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-z4knl\" (UID: \"147606e5-001f-48b5-83ec-d4ad6338248f\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:21:50.200118 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.200081 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/147606e5-001f-48b5-83ec-d4ad6338248f-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-z4knl\" (UID: \"147606e5-001f-48b5-83ec-d4ad6338248f\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:21:50.200118 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.200123 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrfbd\" (UniqueName: \"kubernetes.io/projected/147606e5-001f-48b5-83ec-d4ad6338248f-kube-api-access-xrfbd\") pod \"e2e-distinct-simulated-kserve-ff95456df-z4knl\" (UID: \"147606e5-001f-48b5-83ec-d4ad6338248f\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:21:50.200321 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.200146 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/147606e5-001f-48b5-83ec-d4ad6338248f-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-z4knl\" (UID: \"147606e5-001f-48b5-83ec-d4ad6338248f\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:21:50.200321 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.200171 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/147606e5-001f-48b5-83ec-d4ad6338248f-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-z4knl\" (UID: \"147606e5-001f-48b5-83ec-d4ad6338248f\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:21:50.200321 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.200198 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/147606e5-001f-48b5-83ec-d4ad6338248f-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-z4knl\" (UID: \"147606e5-001f-48b5-83ec-d4ad6338248f\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:21:50.200563 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.200540 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/147606e5-001f-48b5-83ec-d4ad6338248f-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-z4knl\" (UID: \"147606e5-001f-48b5-83ec-d4ad6338248f\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:21:50.200625 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.200610 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/147606e5-001f-48b5-83ec-d4ad6338248f-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-z4knl\" (UID: \"147606e5-001f-48b5-83ec-d4ad6338248f\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:21:50.202527 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.202509 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/147606e5-001f-48b5-83ec-d4ad6338248f-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-z4knl\" (UID: \"147606e5-001f-48b5-83ec-d4ad6338248f\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:21:50.202805 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.202770 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/147606e5-001f-48b5-83ec-d4ad6338248f-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-z4knl\" (UID: \"147606e5-001f-48b5-83ec-d4ad6338248f\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:21:50.210899 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.210868 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrfbd\" (UniqueName: \"kubernetes.io/projected/147606e5-001f-48b5-83ec-d4ad6338248f-kube-api-access-xrfbd\") pod \"e2e-distinct-simulated-kserve-ff95456df-z4knl\" (UID: \"147606e5-001f-48b5-83ec-d4ad6338248f\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:21:50.311092 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.311004 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:21:50.464115 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.464088 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-z4knl"] Jul 01 16:21:50.465641 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:21:50.465609 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147606e5_001f_48b5_83ec_d4ad6338248f.slice/crio-d2da1df32e9b3bbd6793162750d59c30116d2db76f4503d50289cc8e80aab448 WatchSource:0}: Error finding container d2da1df32e9b3bbd6793162750d59c30116d2db76f4503d50289cc8e80aab448: Status 404 returned error can't find the container with id d2da1df32e9b3bbd6793162750d59c30116d2db76f4503d50289cc8e80aab448 Jul 01 16:21:50.540460 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.540425 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zgg88"] Jul 01 16:21:50.935912 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:50.935844 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" event={"ID":"147606e5-001f-48b5-83ec-d4ad6338248f","Type":"ContainerStarted","Data":"d2da1df32e9b3bbd6793162750d59c30116d2db76f4503d50289cc8e80aab448"} Jul 01 16:21:51.942821 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:51.942698 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" event={"ID":"147606e5-001f-48b5-83ec-d4ad6338248f","Type":"ContainerStarted","Data":"0b1a47ea89f5ab54cdbbbb478cd7bec37dce74ebc20fd3f47f32770c38ba71ee"} Jul 01 16:21:51.970012 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:51.969956 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" podStartSLOduration=1.952544531 podStartE2EDuration="2.969938778s" totalImagesPullingTime="1.017394247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:21:51.968748933 +0000 UTC m=+800.020886927" watchObservedRunningTime="2026-07-01 16:21:51.969938778 +0000 UTC m=+800.022076770" Jul 01 16:21:53.202424 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.202381 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt"] Jul 01 16:21:53.206231 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.206212 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:21:53.210123 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.210107 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 01 16:21:53.219085 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.219056 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt"] Jul 01 16:21:53.330644 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.330603 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnpxd\" (UniqueName: \"kubernetes.io/projected/9fb19817-50a5-40d2-8a3b-8f65b7f843fe-kube-api-access-rnpxd\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt\" (UID: \"9fb19817-50a5-40d2-8a3b-8f65b7f843fe\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:21:53.330853 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.330662 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fb19817-50a5-40d2-8a3b-8f65b7f843fe-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt\" (UID: \"9fb19817-50a5-40d2-8a3b-8f65b7f843fe\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:21:53.330853 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.330726 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fb19817-50a5-40d2-8a3b-8f65b7f843fe-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt\" (UID: \"9fb19817-50a5-40d2-8a3b-8f65b7f843fe\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:21:53.330853 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.330793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fb19817-50a5-40d2-8a3b-8f65b7f843fe-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt\" (UID: \"9fb19817-50a5-40d2-8a3b-8f65b7f843fe\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:21:53.331009 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.330881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fb19817-50a5-40d2-8a3b-8f65b7f843fe-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt\" (UID: \"9fb19817-50a5-40d2-8a3b-8f65b7f843fe\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:21:53.432048 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.432009 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnpxd\" (UniqueName: \"kubernetes.io/projected/9fb19817-50a5-40d2-8a3b-8f65b7f843fe-kube-api-access-rnpxd\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt\" (UID: \"9fb19817-50a5-40d2-8a3b-8f65b7f843fe\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:21:53.432048 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.432053 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fb19817-50a5-40d2-8a3b-8f65b7f843fe-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt\" (UID: \"9fb19817-50a5-40d2-8a3b-8f65b7f843fe\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:21:53.432298 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.432083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fb19817-50a5-40d2-8a3b-8f65b7f843fe-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt\" (UID: \"9fb19817-50a5-40d2-8a3b-8f65b7f843fe\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:21:53.432298 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.432111 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fb19817-50a5-40d2-8a3b-8f65b7f843fe-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt\" (UID: \"9fb19817-50a5-40d2-8a3b-8f65b7f843fe\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:21:53.432298 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.432186 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fb19817-50a5-40d2-8a3b-8f65b7f843fe-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt\" (UID: \"9fb19817-50a5-40d2-8a3b-8f65b7f843fe\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:21:53.432515 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.432494 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fb19817-50a5-40d2-8a3b-8f65b7f843fe-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt\" (UID: \"9fb19817-50a5-40d2-8a3b-8f65b7f843fe\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:21:53.432570 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.432533 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fb19817-50a5-40d2-8a3b-8f65b7f843fe-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt\" (UID: \"9fb19817-50a5-40d2-8a3b-8f65b7f843fe\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:21:53.434410 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.434382 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fb19817-50a5-40d2-8a3b-8f65b7f843fe-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt\" (UID: \"9fb19817-50a5-40d2-8a3b-8f65b7f843fe\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:21:53.434680 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.434661 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fb19817-50a5-40d2-8a3b-8f65b7f843fe-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt\" (UID: \"9fb19817-50a5-40d2-8a3b-8f65b7f843fe\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:21:53.444256 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.444234 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnpxd\" (UniqueName: \"kubernetes.io/projected/9fb19817-50a5-40d2-8a3b-8f65b7f843fe-kube-api-access-rnpxd\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt\" (UID: \"9fb19817-50a5-40d2-8a3b-8f65b7f843fe\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:21:53.518275 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.518180 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:21:53.654360 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.654335 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt"] Jul 01 16:21:53.656333 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:21:53.656306 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb19817_50a5_40d2_8a3b_8f65b7f843fe.slice/crio-e6475339d5eb543742de8941d0702c6bf9e8a18b58189129000afd4f306ae676 WatchSource:0}: Error finding container e6475339d5eb543742de8941d0702c6bf9e8a18b58189129000afd4f306ae676: Status 404 returned error can't find the container with id e6475339d5eb543742de8941d0702c6bf9e8a18b58189129000afd4f306ae676 Jul 01 16:21:53.904599 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.904571 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zgg88"] Jul 01 16:21:53.955133 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.955100 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" event={"ID":"9fb19817-50a5-40d2-8a3b-8f65b7f843fe","Type":"ContainerStarted","Data":"8cc60b525ba5a2cedece67f418c24654bcd85187d6eb2c48f285bcb6808a5f7f"} Jul 01 16:21:53.955322 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.955150 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" event={"ID":"9fb19817-50a5-40d2-8a3b-8f65b7f843fe","Type":"ContainerStarted","Data":"e6475339d5eb543742de8941d0702c6bf9e8a18b58189129000afd4f306ae676"} Jul 01 16:21:53.977444 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:53.977393 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" podStartSLOduration=0.802155175 podStartE2EDuration="977.37742ms" totalImagesPullingTime="175.222245ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:21:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:21:53.977289111 +0000 UTC m=+802.029427105" watchObservedRunningTime="2026-07-01 16:21:53.97737742 +0000 UTC m=+802.029515412" Jul 01 16:21:59.413400 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:21:59.413367 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zgg88"] Jul 01 16:22:00.311119 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:00.311079 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:22:00.311324 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:00.311144 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:22:00.323379 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:00.323349 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:22:00.996023 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:00.995993 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-ff95456df-z4knl" Jul 01 16:22:03.518393 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:03.518350 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:22:03.518822 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:03.518430 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:22:03.533736 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:03.533699 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:22:04.009696 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:04.009667 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt" Jul 01 16:22:10.909108 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:10.909068 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b"] Jul 01 16:22:10.912634 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:10.912614 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:10.917751 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:10.917734 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 01 16:22:10.930447 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:10.930421 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b"] Jul 01 16:22:10.968478 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:10.968437 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cdd1347-3017-47e7-a7d9-4a02758d76ba-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b\" (UID: \"2cdd1347-3017-47e7-a7d9-4a02758d76ba\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:10.968478 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:10.968480 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cdd1347-3017-47e7-a7d9-4a02758d76ba-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b\" (UID: \"2cdd1347-3017-47e7-a7d9-4a02758d76ba\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:10.968730 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:10.968587 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cdd1347-3017-47e7-a7d9-4a02758d76ba-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b\" (UID: \"2cdd1347-3017-47e7-a7d9-4a02758d76ba\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:10.968730 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:10.968609 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znchs\" (UniqueName: \"kubernetes.io/projected/2cdd1347-3017-47e7-a7d9-4a02758d76ba-kube-api-access-znchs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b\" (UID: \"2cdd1347-3017-47e7-a7d9-4a02758d76ba\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:10.968730 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:10.968640 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cdd1347-3017-47e7-a7d9-4a02758d76ba-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b\" (UID: \"2cdd1347-3017-47e7-a7d9-4a02758d76ba\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:11.069419 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:11.069332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cdd1347-3017-47e7-a7d9-4a02758d76ba-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b\" (UID: \"2cdd1347-3017-47e7-a7d9-4a02758d76ba\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:11.069419 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:11.069371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znchs\" (UniqueName: \"kubernetes.io/projected/2cdd1347-3017-47e7-a7d9-4a02758d76ba-kube-api-access-znchs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b\" (UID: \"2cdd1347-3017-47e7-a7d9-4a02758d76ba\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:11.069419 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:11.069393 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cdd1347-3017-47e7-a7d9-4a02758d76ba-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b\" (UID: \"2cdd1347-3017-47e7-a7d9-4a02758d76ba\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:11.069628 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:11.069449 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cdd1347-3017-47e7-a7d9-4a02758d76ba-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b\" (UID: \"2cdd1347-3017-47e7-a7d9-4a02758d76ba\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:11.069628 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:11.069474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cdd1347-3017-47e7-a7d9-4a02758d76ba-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b\" (UID: \"2cdd1347-3017-47e7-a7d9-4a02758d76ba\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:11.069869 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:11.069842 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2cdd1347-3017-47e7-a7d9-4a02758d76ba-model-cache\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b\" (UID: \"2cdd1347-3017-47e7-a7d9-4a02758d76ba\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:11.070013 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:11.069880 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2cdd1347-3017-47e7-a7d9-4a02758d76ba-home\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b\" (UID: \"2cdd1347-3017-47e7-a7d9-4a02758d76ba\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:11.071759 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:11.071739 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2cdd1347-3017-47e7-a7d9-4a02758d76ba-dshm\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b\" (UID: \"2cdd1347-3017-47e7-a7d9-4a02758d76ba\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:11.071937 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:11.071918 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2cdd1347-3017-47e7-a7d9-4a02758d76ba-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b\" (UID: \"2cdd1347-3017-47e7-a7d9-4a02758d76ba\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:11.078884 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:11.078861 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znchs\" (UniqueName: \"kubernetes.io/projected/2cdd1347-3017-47e7-a7d9-4a02758d76ba-kube-api-access-znchs\") pod \"facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b\" (UID: \"2cdd1347-3017-47e7-a7d9-4a02758d76ba\") " pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:11.223015 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:11.222971 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:11.365181 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:11.365156 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b"] Jul 01 16:22:11.366877 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:22:11.366850 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cdd1347_3017_47e7_a7d9_4a02758d76ba.slice/crio-e796bae4efe29d3cf1e1bfc72368e678d395545af35839ce572ef015dee244f5 WatchSource:0}: Error finding container e796bae4efe29d3cf1e1bfc72368e678d395545af35839ce572ef015dee244f5: Status 404 returned error can't find the container with id e796bae4efe29d3cf1e1bfc72368e678d395545af35839ce572ef015dee244f5 Jul 01 16:22:12.038729 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:12.038691 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" event={"ID":"2cdd1347-3017-47e7-a7d9-4a02758d76ba","Type":"ContainerStarted","Data":"e03c4753765879f6848a875fd59fb2b3bc4b3ecaa4d5d761f673dea0a9854b93"} Jul 01 16:22:12.039151 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:12.038769 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" event={"ID":"2cdd1347-3017-47e7-a7d9-4a02758d76ba","Type":"ContainerStarted","Data":"e796bae4efe29d3cf1e1bfc72368e678d395545af35839ce572ef015dee244f5"} Jul 01 16:22:12.063323 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:12.063269 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" podStartSLOduration=1.850662139 podStartE2EDuration="2.063252785s" totalImagesPullingTime="212.590646ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 16:22:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:22:12.060701523 +0000 UTC m=+820.112839523" watchObservedRunningTime="2026-07-01 16:22:12.063252785 +0000 UTC m=+820.115390778" Jul 01 16:22:12.100377 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:12.100334 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zgg88"] Jul 01 16:22:20.997861 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:20.997827 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zgg88"] Jul 01 16:22:21.223897 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:21.223848 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:21.224099 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:21.223971 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:21.237704 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:21.237674 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:22:22.097417 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:22:22.097392 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b" Jul 01 16:23:32.353848 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:23:32.353023 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6vrq_d23ea488-6e17-4aa2-969e-f1ac3b448006/ovn-acl-logging/0.log" Jul 01 16:23:32.353848 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:23:32.353057 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g6vrq_d23ea488-6e17-4aa2-969e-f1ac3b448006/ovn-acl-logging/0.log" Jul 01 16:24:03.383846 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:03.383813 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w_1fbeaf5e-0126-443a-a86a-9578f842395d/manager/0.log" Jul 01 16:24:03.390993 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:03.390967 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w_1fbeaf5e-0126-443a-a86a-9578f842395d/copy-manifests/0.log" Jul 01 16:24:04.915569 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:04.915540 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fz9gk_5f23d175-d989-48b1-a711-747238df3c00/manager/0.log" Jul 01 16:24:05.023692 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:05.023662 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2qpcv_2a1010cd-3316-419d-9151-c9696099b523/kuadrant-console-plugin/0.log" Jul 01 16:24:05.385096 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:05.385067 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-zgg88_dcc3aef6-add2-489e-916f-ee120c808c5b/limitador/0.log" Jul 01 16:24:06.177453 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:06.177422 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5545fb4b4d-j7955_b8587130-6895-4d12-9c7c-04d7f4c1de74/kube-auth-proxy/0.log" Jul 01 16:24:06.611404 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:06.611371 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7ff457b8c9-nmq97_22150373-2e93-453b-89da-c649f379b358/router/0.log" Jul 01 16:24:07.059643 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:07.059609 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-ff95456df-z4knl_147606e5-001f-48b5-83ec-d4ad6338248f/main/0.log" Jul 01 16:24:07.176203 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:07.176169 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-74dcdbf7f6-df4xt_9fb19817-50a5-40d2-8a3b-8f65b7f843fe/main/0.log" Jul 01 16:24:07.401484 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:07.401401 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-99c7dfb5c-tfg7b_2cdd1347-3017-47e7-a7d9-4a02758d76ba/main/0.log" Jul 01 16:24:14.904477 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:14.904446 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7p2nk_3d7cf2e2-7fcb-410a-a8b6-7045a9147cc1/global-pull-secret-syncer/0.log" Jul 01 16:24:15.074513 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:15.074482 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fjb2v_d915b269-fc52-4ea6-aa37-4eecff380f0c/konnectivity-agent/0.log" Jul 01 16:24:15.173663 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:15.173568 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-120.ec2.internal_4c211cb0255824f1a3b31f696afaf86f/haproxy/0.log" Jul 01 16:24:20.019230 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:20.019200 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fz9gk_5f23d175-d989-48b1-a711-747238df3c00/manager/0.log" Jul 01 16:24:20.053468 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:20.053394 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-2qpcv_2a1010cd-3316-419d-9151-c9696099b523/kuadrant-console-plugin/0.log" Jul 01 16:24:20.190291 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:20.190267 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-zgg88_dcc3aef6-add2-489e-916f-ee120c808c5b/limitador/0.log" Jul 01 16:24:21.871082 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:21.871054 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bbcc3a2c-34de-4a0e-8476-af7292828d7f/alertmanager/0.log" Jul 01 16:24:21.909075 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:21.909029 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bbcc3a2c-34de-4a0e-8476-af7292828d7f/config-reloader/0.log" Jul 01 16:24:21.939834 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:21.939808 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bbcc3a2c-34de-4a0e-8476-af7292828d7f/kube-rbac-proxy-web/0.log" Jul 01 16:24:21.984419 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:21.984390 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bbcc3a2c-34de-4a0e-8476-af7292828d7f/kube-rbac-proxy/0.log" Jul 01 16:24:22.018163 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:22.018135 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bbcc3a2c-34de-4a0e-8476-af7292828d7f/kube-rbac-proxy-metric/0.log" Jul 01 16:24:22.044469 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:22.044443 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bbcc3a2c-34de-4a0e-8476-af7292828d7f/prom-label-proxy/0.log" Jul 01 16:24:22.076773 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:22.076748 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_bbcc3a2c-34de-4a0e-8476-af7292828d7f/init-config-reloader/0.log" Jul 01 16:24:22.298591 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:22.298549 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7fb8f9cf44-6ftqq_577db653-dd63-4cb2-9754-681662bb5291/metrics-server/0.log" Jul 01 16:24:22.382012 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:22.381989 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4spbl_0cef7446-496a-40c6-96ce-967f98a48273/node-exporter/0.log" Jul 01 16:24:22.415063 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:22.415033 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4spbl_0cef7446-496a-40c6-96ce-967f98a48273/kube-rbac-proxy/0.log" Jul 01 16:24:22.439298 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:22.439273 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4spbl_0cef7446-496a-40c6-96ce-967f98a48273/init-textfile/0.log" Jul 01 16:24:22.838152 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:22.838125 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b/prometheus/0.log" Jul 01 16:24:22.864549 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:22.864526 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b/config-reloader/0.log" Jul 01 16:24:22.890716 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:22.890689 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b/thanos-sidecar/0.log" Jul 01 16:24:22.921462 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:22.921440 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b/kube-rbac-proxy-web/0.log" Jul 01 16:24:22.949724 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:22.949700 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b/kube-rbac-proxy/0.log" Jul 01 16:24:22.985008 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:22.984984 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b/kube-rbac-proxy-thanos/0.log" Jul 01 16:24:23.011812 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:23.011770 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6bd5a7f-b796-4f94-b4c1-03b4875b5f0b/init-config-reloader/0.log" Jul 01 16:24:23.065442 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:23.065412 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-lhtqw_90b6d87b-e09d-49bc-86c8-29b65db74e9a/prometheus-operator/0.log" Jul 01 16:24:23.099408 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:23.099330 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-lhtqw_90b6d87b-e09d-49bc-86c8-29b65db74e9a/kube-rbac-proxy/0.log" Jul 01 16:24:24.636045 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:24.636014 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cdb5968b9-hpjwp_98c4c335-2def-44af-b1a5-933915d2bb6a/networking-console-plugin/0.log" Jul 01 16:24:26.094451 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.094416 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm"] Jul 01 16:24:26.098038 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.098013 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:26.101075 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.101048 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wddzr\"/\"kube-root-ca.crt\"" Jul 01 16:24:26.101211 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.101132 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wddzr\"/\"openshift-service-ca.crt\"" Jul 01 16:24:26.102506 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.102492 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wddzr\"/\"default-dockercfg-x8ctx\"" Jul 01 16:24:26.112959 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.112929 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm"] Jul 01 16:24:26.220616 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.220575 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02d5d6b3-ff22-453a-976c-b4c5b34b9a49-sys\") pod \"perf-node-gather-daemonset-pbgtm\" (UID: \"02d5d6b3-ff22-453a-976c-b4c5b34b9a49\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:26.220811 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.220691 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02d5d6b3-ff22-453a-976c-b4c5b34b9a49-proc\") pod \"perf-node-gather-daemonset-pbgtm\" (UID: \"02d5d6b3-ff22-453a-976c-b4c5b34b9a49\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:26.220811 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.220712 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02d5d6b3-ff22-453a-976c-b4c5b34b9a49-lib-modules\") pod \"perf-node-gather-daemonset-pbgtm\" (UID: \"02d5d6b3-ff22-453a-976c-b4c5b34b9a49\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:26.220898 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.220802 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02d5d6b3-ff22-453a-976c-b4c5b34b9a49-podres\") pod \"perf-node-gather-daemonset-pbgtm\" (UID: \"02d5d6b3-ff22-453a-976c-b4c5b34b9a49\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:26.220898 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.220847 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfrqv\" (UniqueName: \"kubernetes.io/projected/02d5d6b3-ff22-453a-976c-b4c5b34b9a49-kube-api-access-qfrqv\") pod \"perf-node-gather-daemonset-pbgtm\" (UID: \"02d5d6b3-ff22-453a-976c-b4c5b34b9a49\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:26.322173 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.322129 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02d5d6b3-ff22-453a-976c-b4c5b34b9a49-proc\") pod \"perf-node-gather-daemonset-pbgtm\" (UID: \"02d5d6b3-ff22-453a-976c-b4c5b34b9a49\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:26.322173 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.322173 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02d5d6b3-ff22-453a-976c-b4c5b34b9a49-lib-modules\") pod \"perf-node-gather-daemonset-pbgtm\" (UID: \"02d5d6b3-ff22-453a-976c-b4c5b34b9a49\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:26.322434 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.322192 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02d5d6b3-ff22-453a-976c-b4c5b34b9a49-podres\") pod \"perf-node-gather-daemonset-pbgtm\" (UID: \"02d5d6b3-ff22-453a-976c-b4c5b34b9a49\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:26.322434 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.322214 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfrqv\" (UniqueName: \"kubernetes.io/projected/02d5d6b3-ff22-453a-976c-b4c5b34b9a49-kube-api-access-qfrqv\") pod \"perf-node-gather-daemonset-pbgtm\" (UID: \"02d5d6b3-ff22-453a-976c-b4c5b34b9a49\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:26.322434 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.322257 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02d5d6b3-ff22-453a-976c-b4c5b34b9a49-proc\") pod \"perf-node-gather-daemonset-pbgtm\" (UID: \"02d5d6b3-ff22-453a-976c-b4c5b34b9a49\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:26.322434 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.322263 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02d5d6b3-ff22-453a-976c-b4c5b34b9a49-sys\") pod \"perf-node-gather-daemonset-pbgtm\" (UID: \"02d5d6b3-ff22-453a-976c-b4c5b34b9a49\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:26.322434 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.322314 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02d5d6b3-ff22-453a-976c-b4c5b34b9a49-sys\") pod \"perf-node-gather-daemonset-pbgtm\" (UID: \"02d5d6b3-ff22-453a-976c-b4c5b34b9a49\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:26.322434 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.322327 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02d5d6b3-ff22-453a-976c-b4c5b34b9a49-podres\") pod \"perf-node-gather-daemonset-pbgtm\" (UID: \"02d5d6b3-ff22-453a-976c-b4c5b34b9a49\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:26.322434 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.322336 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02d5d6b3-ff22-453a-976c-b4c5b34b9a49-lib-modules\") pod \"perf-node-gather-daemonset-pbgtm\" (UID: \"02d5d6b3-ff22-453a-976c-b4c5b34b9a49\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:26.331697 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.331666 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfrqv\" (UniqueName: \"kubernetes.io/projected/02d5d6b3-ff22-453a-976c-b4c5b34b9a49-kube-api-access-qfrqv\") pod \"perf-node-gather-daemonset-pbgtm\" (UID: \"02d5d6b3-ff22-453a-976c-b4c5b34b9a49\") " pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:26.407500 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.407413 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:26.545528 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.545496 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm"] Jul 01 16:24:26.548978 ip-10-0-136-120 kubenswrapper[2564]: W0701 16:24:26.548955 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod02d5d6b3_ff22_453a_976c_b4c5b34b9a49.slice/crio-234967bac265f264a7de4763db2c79e95851f98f361d319db11ccc9c7d73ec40 WatchSource:0}: Error finding container 234967bac265f264a7de4763db2c79e95851f98f361d319db11ccc9c7d73ec40: Status 404 returned error can't find the container with id 234967bac265f264a7de4763db2c79e95851f98f361d319db11ccc9c7d73ec40 Jul 01 16:24:26.554836 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.554818 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-lz8wv_2ceb791b-b65c-4745-af66-416c7137858d/volume-data-source-validator/0.log" Jul 01 16:24:26.664976 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:26.664893 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" event={"ID":"02d5d6b3-ff22-453a-976c-b4c5b34b9a49","Type":"ContainerStarted","Data":"234967bac265f264a7de4763db2c79e95851f98f361d319db11ccc9c7d73ec40"} Jul 01 16:24:27.677873 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:27.677824 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" event={"ID":"02d5d6b3-ff22-453a-976c-b4c5b34b9a49","Type":"ContainerStarted","Data":"159d538e6af62bc883ab35ff979dcaf5c32d024b56d7493efe7bbf375a4fb764"} Jul 01 16:24:27.678319 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:27.677930 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:27.682186 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:27.682164 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7crn7_31d847e5-8b59-4754-8125-5574445399b3/dns/0.log" Jul 01 16:24:27.700319 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:27.700270 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" podStartSLOduration=1.7002557 podStartE2EDuration="1.7002557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 16:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 16:24:27.699957125 +0000 UTC m=+955.752095118" watchObservedRunningTime="2026-07-01 16:24:27.7002557 +0000 UTC m=+955.752393693" Jul 01 16:24:27.714273 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:27.714245 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7crn7_31d847e5-8b59-4754-8125-5574445399b3/kube-rbac-proxy/0.log" Jul 01 16:24:27.895802 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:27.895762 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9hlsb_bd4aeddd-e9ce-47a5-8bce-fdfad39ed39b/dns-node-resolver/0.log" Jul 01 16:24:28.506687 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:28.506659 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6cdf76f5c8-6m788_15cb0df7-84bf-4127-b479-f49b18c3a9e3/registry/0.log" Jul 01 16:24:28.580519 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:28.580478 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kxwbh_a7f787d9-3e7b-490b-a193-80ac2c5b8d3d/node-ca/0.log" Jul 01 16:24:29.797057 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:29.797023 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5545fb4b4d-j7955_b8587130-6895-4d12-9c7c-04d7f4c1de74/kube-auth-proxy/0.log" Jul 01 16:24:29.919470 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:29.919446 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7ff457b8c9-nmq97_22150373-2e93-453b-89da-c649f379b358/router/0.log" Jul 01 16:24:30.590565 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:30.590533 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6pkqr_509edfc7-789d-4b9e-aa59-ab1e58518e50/serve-healthcheck-canary/0.log" Jul 01 16:24:31.202180 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:31.202148 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-t4c2t_be8e3866-367a-4db4-b049-ed6e537345a2/insights-operator/0.log" Jul 01 16:24:31.203551 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:31.203530 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-t4c2t_be8e3866-367a-4db4-b049-ed6e537345a2/insights-operator/1.log" Jul 01 16:24:31.227960 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:31.227923 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-266ns_76c6eb34-fa15-4a8b-aa39-96f04c90038f/kube-rbac-proxy/0.log" Jul 01 16:24:31.251276 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:31.251248 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-266ns_76c6eb34-fa15-4a8b-aa39-96f04c90038f/exporter/0.log" Jul 01 16:24:31.275198 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:31.275174 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-266ns_76c6eb34-fa15-4a8b-aa39-96f04c90038f/extractor/0.log" Jul 01 16:24:33.692920 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:33.692892 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wddzr/perf-node-gather-daemonset-pbgtm" Jul 01 16:24:34.130684 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:34.130652 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w_1fbeaf5e-0126-443a-a86a-9578f842395d/manager/0.log" Jul 01 16:24:34.157412 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:34.157384 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77cbf7fc9f-x4h5w_1fbeaf5e-0126-443a-a86a-9578f842395d/copy-manifests/0.log" Jul 01 16:24:35.104335 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:35.104309 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5545fb4b4d-j7955_b8587130-6895-4d12-9c7c-04d7f4c1de74/kube-auth-proxy/0.log" Jul 01 16:24:35.177678 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:35.177651 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7ff457b8c9-nmq97_22150373-2e93-453b-89da-c649f379b358/router/0.log" Jul 01 16:24:35.717487 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:35.717463 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-69bb744ddb-578d7_e58f617c-2384-44c9-b6d7-379ebdaf5d79/manager/0.log" Jul 01 16:24:36.526827 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:36.526801 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5545fb4b4d-j7955_b8587130-6895-4d12-9c7c-04d7f4c1de74/kube-auth-proxy/0.log" Jul 01 16:24:36.616705 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:36.616679 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7ff457b8c9-nmq97_22150373-2e93-453b-89da-c649f379b358/router/0.log" Jul 01 16:24:43.213908 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:43.213875 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xcz47_dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b/kube-multus-additional-cni-plugins/0.log" Jul 01 16:24:43.246873 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:43.246836 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xcz47_dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b/egress-router-binary-copy/0.log" Jul 01 16:24:43.278143 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:43.278113 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xcz47_dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b/cni-plugins/0.log" Jul 01 16:24:43.305044 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:43.305014 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xcz47_dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b/bond-cni-plugin/0.log" Jul 01 16:24:43.332162 ip-10-0-136-120 kubenswrapper[2564]: I0701 16:24:43.332134 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xcz47_dcefdbc4-f5cd-41cc-b23c-2dd6f9f8798b/routeoverride-cni/0.log"