Jul 06 20:40:49.859855 ip-10-0-134-228 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 20:40:49.859867 ip-10-0-134-228 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 20:40:49.859875 ip-10-0-134-228 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 20:40:49.860167 ip-10-0-134-228 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 20:41:00.057082 ip-10-0-134-228 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 20:41:00.057099 ip-10-0-134-228 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 998daebbe1494c0da896f58b418475a2 -- Jul 06 20:42:55.788980 ip-10-0-134-228 systemd[1]: Starting Kubernetes Kubelet... Jul 06 20:42:57.219175 ip-10-0-134-228 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:42:57.219175 ip-10-0-134-228 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 20:42:57.219175 ip-10-0-134-228 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:42:57.219175 ip-10-0-134-228 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 20:42:57.219175 ip-10-0-134-228 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 20:42:57.219847 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.219191 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 20:42:57.224238 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224219 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:42:57.224290 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224241 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:42:57.224290 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224246 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:42:57.224290 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224250 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:42:57.224290 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224260 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:42:57.224290 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224264 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:42:57.224290 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224268 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:42:57.224290 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224271 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:42:57.224290 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224274 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:42:57.224290 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224277 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:42:57.224290 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224281 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:42:57.224290 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224283 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:42:57.224290 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224286 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:42:57.224290 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224289 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:42:57.224290 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224292 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:42:57.224290 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224295 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:42:57.224290 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224298 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224301 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224304 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224307 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224310 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224312 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224315 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224318 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224321 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224323 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224326 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224328 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224331 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224334 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224336 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224339 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224342 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224345 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224348 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224350 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:42:57.224686 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224353 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224356 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224359 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224361 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224364 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224366 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224370 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224373 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224375 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224380 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224383 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224386 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224389 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224393 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224396 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224398 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224401 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224404 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224406 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:42:57.225224 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224409 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224412 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224414 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224417 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224420 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224423 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224432 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224435 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224438 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224441 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224443 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224450 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224453 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224455 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224458 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224461 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224464 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224466 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224469 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224473 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:42:57.225711 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224476 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224479 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224481 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224484 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224488 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224492 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224495 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224498 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224500 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224503 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224506 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224509 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224511 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224515 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224517 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224520 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224523 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224526 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224528 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224531 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:42:57.226214 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224536 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224538 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224541 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.224544 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225369 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225377 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225380 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225384 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225388 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225391 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225394 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225398 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225401 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225404 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225406 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225409 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225412 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225415 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225418 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225421 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:42:57.226726 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225424 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225428 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225433 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225436 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225439 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225443 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225446 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225449 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225452 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225455 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225458 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225461 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225463 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225466 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225469 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225471 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225474 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225477 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225480 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:42:57.227257 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225482 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225485 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225488 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225490 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225494 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225497 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225500 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225502 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225505 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225508 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225510 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225513 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225516 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225518 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225524 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225528 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225531 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225534 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225537 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:42:57.227740 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225540 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225543 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225546 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225548 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225551 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225554 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225556 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225559 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225561 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225565 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225568 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225571 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225573 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225579 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225581 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225584 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225588 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225592 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225595 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225597 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:42:57.228237 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225600 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225603 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225606 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225609 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225611 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225615 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225619 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225623 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225626 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225629 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225632 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225634 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225637 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225640 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225643 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225645 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225648 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225651 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225654 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:42:57.228757 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225656 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225659 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225662 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225665 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225667 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.225670 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226093 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226099 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226103 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226107 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226110 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226113 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226116 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226137 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226141 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226144 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226147 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226151 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226154 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226157 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:42:57.229254 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226160 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226163 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226166 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226169 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226171 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226174 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226177 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226181 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226183 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226186 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226189 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226192 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226194 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226197 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226200 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226202 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226205 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226209 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226213 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226217 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:42:57.229793 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226219 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226222 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226229 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226232 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226235 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226238 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226241 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226244 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226246 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226249 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226253 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226255 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226258 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226261 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226263 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226266 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226269 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226272 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226274 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:42:57.230343 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226277 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226281 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226285 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226288 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226291 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226294 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226297 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226301 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226304 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226307 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226312 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226316 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226320 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226323 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226326 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226328 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226332 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226334 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:42:57.230844 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226337 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226340 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226343 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226345 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226348 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226351 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226354 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226357 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226359 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226363 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226366 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226368 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226371 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226374 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226376 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226379 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226381 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226384 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226387 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226389 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:42:57.231387 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226392 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226395 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226398 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226400 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226404 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226407 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226410 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.226413 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226484 2579 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226492 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226499 2579 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226507 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226514 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226520 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226527 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226533 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226537 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226540 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226544 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226548 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226551 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226555 2579 flags.go:64] FLAG: --cgroup-root="" Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226558 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 20:42:57.231909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226561 2579 flags.go:64] FLAG: --client-ca-file="" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226564 2579 flags.go:64] FLAG: --cloud-provider="external" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226567 2579 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226572 2579 flags.go:64] FLAG: --cluster-domain="" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226575 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226578 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226581 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226585 2579 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226589 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226592 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226595 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226599 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226602 2579 flags.go:64] FLAG: --contention-profiling="false" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226606 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226610 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226613 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226617 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226621 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226625 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226629 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226632 2579 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226635 2579 flags.go:64] FLAG: --enable-server="true" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226639 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226644 2579 flags.go:64] FLAG: --event-burst="100" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226647 2579 flags.go:64] FLAG: --event-qps="50" Jul 06 20:42:57.232523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226650 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226654 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226657 2579 flags.go:64] FLAG: --eviction-hard="" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226661 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226664 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226667 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226670 2579 flags.go:64] FLAG: --eviction-soft="" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226673 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226676 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226679 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226683 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226686 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226689 2579 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226692 2579 flags.go:64] FLAG: --feature-gates="" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226696 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226700 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226703 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226706 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226709 2579 flags.go:64] FLAG: --healthz-port="10248" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226717 2579 flags.go:64] FLAG: --help="false" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226720 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226723 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226726 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 20:42:57.233218 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226730 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226734 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226737 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226741 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226744 2579 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226747 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226750 2579 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226753 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226757 2579 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226760 2579 flags.go:64] FLAG: --kube-reserved="" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226763 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226766 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226769 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226773 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226776 2579 flags.go:64] FLAG: --lock-file="" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226779 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226781 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226784 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226790 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226793 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226796 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226799 2579 flags.go:64] FLAG: --logging-format="text" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226801 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226805 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 20:42:57.233832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226808 2579 flags.go:64] FLAG: --manifest-url="" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226811 2579 flags.go:64] FLAG: --manifest-url-header="" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226815 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226818 2579 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226825 2579 flags.go:64] FLAG: --max-pods="110" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226829 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226832 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226835 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226838 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226842 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226845 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226848 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226856 2579 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226859 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226862 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226866 2579 flags.go:64] FLAG: --pod-cidr="" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226869 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226875 2579 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226879 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226882 2579 flags.go:64] FLAG: --pods-per-core="0" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226885 2579 flags.go:64] FLAG: --port="10250" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226888 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226891 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bdfe4958d8739029" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226895 2579 flags.go:64] FLAG: --qos-reserved="" Jul 06 20:42:57.234599 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226898 2579 flags.go:64] FLAG: --read-only-port="10255" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226901 2579 flags.go:64] FLAG: --register-node="true" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226904 2579 flags.go:64] FLAG: --register-with-taints="" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226907 2579 flags.go:64] FLAG: --registry-burst="10" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226910 2579 flags.go:64] FLAG: --registry-qps="5" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226914 2579 flags.go:64] FLAG: --reserved-cpus="" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226917 2579 flags.go:64] FLAG: --reserved-memory="" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226920 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226924 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226927 2579 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226930 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226933 2579 flags.go:64] FLAG: --runonce="false" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226939 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226943 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226947 2579 flags.go:64] FLAG: --seccomp-default="false" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226951 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226954 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226957 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226960 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226963 2579 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226966 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226969 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226973 2579 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226976 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226981 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 20:42:57.235631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226984 2579 flags.go:64] FLAG: --system-cgroups="" Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226987 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226992 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226995 2579 flags.go:64] FLAG: --tls-cert-file="" Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.226999 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.227003 2579 flags.go:64] FLAG: --tls-min-version="" Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.227006 2579 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.227009 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.227012 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.227016 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.227019 2579 flags.go:64] FLAG: --v="2" Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.227023 2579 flags.go:64] FLAG: --version="false" Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.227028 2579 flags.go:64] FLAG: --vmodule="" Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.227032 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.227035 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227174 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227179 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227182 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227185 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227189 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227192 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227196 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227199 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:42:57.236344 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227202 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227205 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227208 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227210 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227213 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227216 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227219 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227222 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227225 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227228 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227231 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227234 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227236 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227239 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227242 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227245 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227247 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227250 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227253 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227255 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:42:57.236936 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227258 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227261 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227264 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227267 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227270 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227272 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227275 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227278 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227282 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227285 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227289 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227292 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227295 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227297 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227300 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227303 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227306 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227309 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227312 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227314 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:42:57.237559 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227317 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227320 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227323 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227326 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227329 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227332 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227334 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227337 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227340 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227343 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227345 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227348 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227351 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227353 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227356 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227359 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227362 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227364 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227367 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227370 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:42:57.238068 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227375 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227377 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227382 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227385 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227388 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227390 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227393 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227396 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227398 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227402 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227406 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227408 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227411 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227414 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227416 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227420 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227422 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227425 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227428 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:42:57.238659 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227431 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:42:57.239167 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227435 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:42:57.239167 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227438 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:42:57.239167 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227441 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:42:57.239167 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227444 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:42:57.239167 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227447 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:42:57.239167 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227451 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:42:57.239167 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227453 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:42:57.239167 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227457 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:42:57.239167 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227460 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:42:57.239167 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227463 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:42:57.239167 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.227467 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:42:57.239167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.228092 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:42:57.239167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.237154 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 20:42:57.239167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.237175 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.238001 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.238010 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238076 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238083 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238086 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238090 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238093 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238096 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238099 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238102 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238106 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238109 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238114 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238131 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238135 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238138 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238141 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238145 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:42:57.239547 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238148 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238151 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238154 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238157 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238160 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238163 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238166 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238169 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238172 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238175 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238178 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238180 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238185 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238191 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238194 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238197 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238200 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238203 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238206 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238209 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:42:57.240036 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238212 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238215 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238218 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238221 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238224 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238226 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238229 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238233 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238235 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238238 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238242 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238246 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238249 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238252 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238254 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238257 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238260 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238263 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238266 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238268 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:42:57.240572 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238271 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238274 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238277 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238279 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238282 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238286 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238289 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238293 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238296 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238298 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238301 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238304 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238307 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238310 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238312 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238315 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238319 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238321 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238324 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:42:57.241093 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238327 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238332 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238335 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238338 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238342 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238345 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238348 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238351 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238353 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238356 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238359 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238362 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238364 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238367 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238370 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238372 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238375 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238378 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238382 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238385 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:42:57.241721 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238388 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:42:57.242247 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238391 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:42:57.242247 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238394 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:42:57.242247 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238397 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:42:57.242247 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.238402 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:42:57.242247 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238531 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 20:42:57.242247 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238537 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 20:42:57.242247 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238540 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 20:42:57.242247 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238543 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 20:42:57.242247 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238546 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 20:42:57.242247 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238549 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 20:42:57.242247 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238552 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 20:42:57.242247 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238555 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 20:42:57.242247 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238558 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 20:42:57.242247 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238561 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238564 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238567 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238571 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238574 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238577 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238580 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238583 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238585 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238588 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238591 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238594 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238597 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238600 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238603 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238606 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238609 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238612 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238615 2579 feature_gate.go:328] unrecognized feature gate: Example Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238618 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 20:42:57.242622 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238621 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238624 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238626 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238629 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238632 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238635 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238638 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238640 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238643 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238646 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238648 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238651 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238654 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238656 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238659 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238662 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238665 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238668 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238671 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238674 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 20:42:57.243199 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238677 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238680 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238683 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238686 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238688 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238691 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238694 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238697 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238700 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238703 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238705 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238708 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238710 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238713 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238716 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238719 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238721 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238724 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238727 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238730 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 20:42:57.243717 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238733 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238736 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238740 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238744 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238748 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238753 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238756 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238759 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238762 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238765 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238769 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238772 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238775 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238777 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238780 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238783 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238786 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238789 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238792 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 20:42:57.244245 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238794 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 20:42:57.244736 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238797 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 20:42:57.244736 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238800 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 20:42:57.244736 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238803 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 20:42:57.244736 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238805 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 20:42:57.244736 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238808 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 20:42:57.244736 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238811 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 20:42:57.244736 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238814 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 20:42:57.244736 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238816 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 20:42:57.244736 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238819 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 20:42:57.244736 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:57.238822 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 20:42:57.244736 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.238827 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 20:42:57.244736 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.238960 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 20:42:57.244736 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.242282 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 20:42:57.244736 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.243827 2579 server.go:1019] "Starting client certificate rotation" Jul 06 20:42:57.245107 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.243945 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:42:57.245107 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.244017 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 20:42:57.246602 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.246577 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:42:57.247853 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.247832 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 20:42:57.258492 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.258466 2579 log.go:25] "Validated CRI v1 runtime API" Jul 06 20:42:57.260871 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.260853 2579 log.go:25] "Validated CRI v1 image API" Jul 06 20:42:57.261776 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.261759 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 20:42:57.266060 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.266035 2579 fs.go:135] Filesystem UUIDs: map[5bd94cae-0f38-4657-919c-c0f6e33a4d4e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a3a8625c-dd2e-4df7-84c8-a17de3bfa774:/dev/nvme0n1p3] Jul 06 20:42:57.266149 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.266059 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 20:42:57.273251 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.273107 2579 manager.go:216] Machine: {Timestamp:2026-07-06 20:42:57.271777977 +0000 UTC m=+1.360283008 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3119318 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b1b65fafdf28935522d0db5ab14f4 SystemUUID:ec2b1b65-fafd-f289-3552-2d0db5ab14f4 BootID:998daebb-e149-4c0d-a896-f58b418475a2 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:91:d1:7a:de:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:91:d1:7a:de:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:71:bb:1a:c2:89 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 20:42:57.273251 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.273235 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 20:42:57.273396 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.273329 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 20:42:57.276505 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.276465 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 20:42:57.276690 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.276508 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-228.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 20:42:57.277932 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.277921 2579 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 20:42:57.277967 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.277935 2579 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 20:42:57.277967 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.277944 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:42:57.278648 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.278636 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 20:42:57.280097 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.280086 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 20:42:57.283448 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.283428 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:42:57.283564 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.283554 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 20:42:57.284215 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.284204 2579 kubelet.go:486] "Attempting to sync node with API server" Jul 06 20:42:57.284261 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.284219 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 20:42:57.284261 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.284237 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 20:42:57.284261 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.284247 2579 kubelet.go:398] "Adding apiserver pod source" Jul 06 20:42:57.284261 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.284257 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 20:42:57.284796 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.284782 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:42:57.284833 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.284808 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 20:42:57.287366 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.287348 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 20:42:57.289562 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.289544 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 20:42:57.289645 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.289586 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 20:42:57.290917 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.290903 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 20:42:57.291024 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.290937 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 20:42:57.291024 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.290947 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 20:42:57.291024 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.290955 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 20:42:57.291024 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.290968 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 20:42:57.291024 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.290977 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 20:42:57.291024 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.290990 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 20:42:57.291024 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.290999 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 20:42:57.291024 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.291011 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 20:42:57.291024 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.291020 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 20:42:57.291337 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.291033 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 20:42:57.291337 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.291059 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 20:42:57.291879 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.291868 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 20:42:57.291930 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.291882 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 20:42:57.295576 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.295558 2579 server.go:1268] "Started kubelet" Jul 06 20:42:57.295723 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.295660 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 20:42:57.295777 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.295665 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 20:42:57.295895 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.295870 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 20:42:57.296685 ip-10-0-134-228 systemd[1]: Started Kubernetes Kubelet. Jul 06 20:42:57.297439 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.296777 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-228.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 20:42:57.297439 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.296777 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 20:42:57.297439 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.296954 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 20:42:57.298047 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.298014 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 20:42:57.298178 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.298163 2579 server.go:310] "Adding debug handlers to kubelet server" Jul 06 20:42:57.303644 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.303625 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 20:42:57.305240 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.305224 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 20:42:57.305310 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.305240 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 20:42:57.305364 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.305310 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-228.ec2.internal\" not found" Jul 06 20:42:57.306948 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.306787 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 20:42:57.307040 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.307029 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 20:42:57.308256 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.308236 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 20:42:57.308361 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.308257 2579 factory.go:55] Registering systemd factory Jul 06 20:42:57.308361 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.308276 2579 factory.go:223] Registration of the systemd container factory successfully Jul 06 20:42:57.308474 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.308381 2579 reconstruct.go:97] "Volume reconstruction finished" Jul 06 20:42:57.308474 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.308394 2579 reconciler.go:29] "Reconciler: start to sync state" Jul 06 20:42:57.310771 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.310704 2579 factory.go:153] Registering CRI-O factory Jul 06 20:42:57.310771 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.310773 2579 factory.go:223] Registration of the crio container factory successfully Jul 06 20:42:57.311005 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.310839 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 20:42:57.311005 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.310880 2579 factory.go:103] Registering Raw factory Jul 06 20:42:57.311005 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.310901 2579 manager.go:1196] Started watching for new ooms in manager Jul 06 20:42:57.312511 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.312491 2579 manager.go:349] Starting recovery of all containers Jul 06 20:42:57.314686 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.314650 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:42:57.316101 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.316076 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 20:42:57.316263 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.316211 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 20:42:57.317112 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.316122 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-228.ec2.internal.18bfce17629558db default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-228.ec2.internal,UID:ip-10-0-134-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-228.ec2.internal,},FirstTimestamp:2026-07-06 20:42:57.295530203 +0000 UTC m=+1.384035235,LastTimestamp:2026-07-06 20:42:57.295530203 +0000 UTC m=+1.384035235,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-228.ec2.internal,}" Jul 06 20:42:57.323285 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.323267 2579 manager.go:354] Recovery completed Jul 06 20:42:57.327699 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.327685 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:42:57.329698 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.329672 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:42:57.329762 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.329711 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:42:57.329762 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.329726 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:42:57.330321 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.330296 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 20:42:57.330321 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.330312 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 20:42:57.330396 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.330326 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:42:57.330396 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.330358 2579 state_mem.go:36] "Initialized new in-memory state store" Jul 06 20:42:57.331147 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.331116 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:42:57.331201 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.331163 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:42:57.331201 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.331178 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:42:57.331571 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.331559 2579 policy_none.go:49] "None policy: Start" Jul 06 20:42:57.331608 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.331577 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 20:42:57.331608 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.331588 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 20:42:57.332720 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.332708 2579 policy_none.go:47] "Start" Jul 06 20:42:57.335369 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.335294 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-228.ec2.internal.18bfce17649eaf48 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-228.ec2.internal,UID:ip-10-0-134-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-228.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-228.ec2.internal,},FirstTimestamp:2026-07-06 20:42:57.329696584 +0000 UTC m=+1.418201615,LastTimestamp:2026-07-06 20:42:57.329696584 +0000 UTC m=+1.418201615,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-228.ec2.internal,}" Jul 06 20:42:57.354295 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.354070 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-228.ec2.internal.18bfce17649efd5b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-228.ec2.internal,UID:ip-10-0-134-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-228.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-228.ec2.internal,},FirstTimestamp:2026-07-06 20:42:57.329716571 +0000 UTC m=+1.418221602,LastTimestamp:2026-07-06 20:42:57.329716571 +0000 UTC m=+1.418221602,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-228.ec2.internal,}" Jul 06 20:42:57.359344 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.359273 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-228.ec2.internal.18bfce17649f3c22 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-228.ec2.internal,UID:ip-10-0-134-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-228.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-228.ec2.internal,},FirstTimestamp:2026-07-06 20:42:57.329732642 +0000 UTC m=+1.418237676,LastTimestamp:2026-07-06 20:42:57.329732642 +0000 UTC m=+1.418237676,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-228.ec2.internal,}" Jul 06 20:42:57.370812 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.370738 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-228.ec2.internal.18bfce17649eaf48\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-228.ec2.internal.18bfce17649eaf48 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-228.ec2.internal,UID:ip-10-0-134-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-228.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-228.ec2.internal,},FirstTimestamp:2026-07-06 20:42:57.329696584 +0000 UTC m=+1.418201615,LastTimestamp:2026-07-06 20:42:57.331146399 +0000 UTC m=+1.419651431,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-228.ec2.internal,}" Jul 06 20:42:57.378743 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.378719 2579 manager.go:337] "Starting Device Plugin manager" Jul 06 20:42:57.378819 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.378757 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 20:42:57.378819 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.378768 2579 server.go:87] "Starting device plugin registration server" Jul 06 20:42:57.379113 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.379085 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 20:42:57.379171 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.379117 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 20:42:57.379222 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.379204 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 20:42:57.379311 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.379297 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 20:42:57.379311 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.379310 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 20:42:57.379923 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.379902 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 20:42:57.380009 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.379951 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-228.ec2.internal\" not found" Jul 06 20:42:57.387590 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.387522 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-228.ec2.internal.18bfce17649efd5b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-228.ec2.internal.18bfce17649efd5b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-228.ec2.internal,UID:ip-10-0-134-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-228.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-228.ec2.internal,},FirstTimestamp:2026-07-06 20:42:57.329716571 +0000 UTC m=+1.418221602,LastTimestamp:2026-07-06 20:42:57.331169928 +0000 UTC m=+1.419674962,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-228.ec2.internal,}" Jul 06 20:42:57.400673 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.400601 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-228.ec2.internal.18bfce17649f3c22\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-228.ec2.internal.18bfce17649f3c22 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-228.ec2.internal,UID:ip-10-0-134-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-228.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-228.ec2.internal,},FirstTimestamp:2026-07-06 20:42:57.329732642 +0000 UTC m=+1.418237676,LastTimestamp:2026-07-06 20:42:57.331182854 +0000 UTC m=+1.419687886,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-228.ec2.internal,}" Jul 06 20:42:57.416171 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.416076 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-228.ec2.internal.18bfce1767ae2bf6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-228.ec2.internal,UID:ip-10-0-134-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-134-228.ec2.internal,},FirstTimestamp:2026-07-06 20:42:57.38104319 +0000 UTC m=+1.469548220,LastTimestamp:2026-07-06 20:42:57.38104319 +0000 UTC m=+1.469548220,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-228.ec2.internal,}" Jul 06 20:42:57.417819 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.417787 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 20:42:57.419068 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.419040 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 20:42:57.419159 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.419094 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 20:42:57.419159 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.419142 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 20:42:57.419254 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.419187 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 20:42:57.430829 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.430801 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jul 06 20:42:57.481452 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.481345 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:42:57.482501 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.482480 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:42:57.482602 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.482520 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:42:57.482602 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.482538 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:42:57.482602 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.482565 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.496901 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.496818 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-228.ec2.internal.18bfce17649eaf48\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-228.ec2.internal.18bfce17649eaf48 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-228.ec2.internal,UID:ip-10-0-134-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-228.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-228.ec2.internal,},FirstTimestamp:2026-07-06 20:42:57.329696584 +0000 UTC m=+1.418201615,LastTimestamp:2026-07-06 20:42:57.482501961 +0000 UTC m=+1.571006994,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-228.ec2.internal,}" Jul 06 20:42:57.501032 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.501001 2579 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-134-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.501147 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.501009 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-228.ec2.internal.18bfce17649efd5b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-228.ec2.internal.18bfce17649efd5b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-228.ec2.internal,UID:ip-10-0-134-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-228.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-228.ec2.internal,},FirstTimestamp:2026-07-06 20:42:57.329716571 +0000 UTC m=+1.418221602,LastTimestamp:2026-07-06 20:42:57.482528083 +0000 UTC m=+1.571033115,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-228.ec2.internal,}" Jul 06 20:42:57.512796 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.512723 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-228.ec2.internal.18bfce17649f3c22\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-228.ec2.internal.18bfce17649f3c22 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-228.ec2.internal,UID:ip-10-0-134-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-228.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-228.ec2.internal,},FirstTimestamp:2026-07-06 20:42:57.329732642 +0000 UTC m=+1.418237676,LastTimestamp:2026-07-06 20:42:57.48254324 +0000 UTC m=+1.571048271,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-228.ec2.internal,}" Jul 06 20:42:57.520548 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.519874 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-228.ec2.internal"] Jul 06 20:42:57.520624 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.520590 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:42:57.521551 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.521531 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:42:57.521618 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.521568 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:42:57.521618 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.521583 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:42:57.522791 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.522777 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:42:57.522914 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.522901 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.522962 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.522931 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:42:57.523607 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.523589 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:42:57.523684 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.523624 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:42:57.523684 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.523634 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:42:57.523684 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.523640 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:42:57.523684 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.523653 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:42:57.523684 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.523666 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:42:57.524748 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.524725 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.524748 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.524751 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:42:57.525519 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.525501 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:42:57.525600 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.525535 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:42:57.525600 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.525549 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:42:57.532323 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.532244 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-228.ec2.internal.18bfce17649eaf48\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-228.ec2.internal.18bfce17649eaf48 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-228.ec2.internal,UID:ip-10-0-134-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-228.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-228.ec2.internal,},FirstTimestamp:2026-07-06 20:42:57.329696584 +0000 UTC m=+1.418201615,LastTimestamp:2026-07-06 20:42:57.521550542 +0000 UTC m=+1.610055575,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-228.ec2.internal,}" Jul 06 20:42:57.532882 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.532857 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-228.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms" Jul 06 20:42:57.542710 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.542689 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-228.ec2.internal\" not found" node="ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.547045 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.547025 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-228.ec2.internal\" not found" node="ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.549093 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.549022 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-228.ec2.internal.18bfce17649efd5b\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-228.ec2.internal.18bfce17649efd5b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-228.ec2.internal,UID:ip-10-0-134-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-228.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-228.ec2.internal,},FirstTimestamp:2026-07-06 20:42:57.329716571 +0000 UTC m=+1.418221602,LastTimestamp:2026-07-06 20:42:57.521576325 +0000 UTC m=+1.610081357,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-228.ec2.internal,}" Jul 06 20:42:57.563595 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.563506 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-228.ec2.internal.18bfce17649f3c22\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-228.ec2.internal.18bfce17649f3c22 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-228.ec2.internal,UID:ip-10-0-134-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-228.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-228.ec2.internal,},FirstTimestamp:2026-07-06 20:42:57.329732642 +0000 UTC m=+1.418237676,LastTimestamp:2026-07-06 20:42:57.521587281 +0000 UTC m=+1.610092313,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-228.ec2.internal,}" Jul 06 20:42:57.576961 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.576930 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vm76b" Jul 06 20:42:57.588422 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.588339 2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-228.ec2.internal.18bfce17649eaf48\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-228.ec2.internal.18bfce17649eaf48 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-228.ec2.internal,UID:ip-10-0-134-228.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-228.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-228.ec2.internal,},FirstTimestamp:2026-07-06 20:42:57.329696584 +0000 UTC m=+1.418201615,LastTimestamp:2026-07-06 20:42:57.523606174 +0000 UTC m=+1.612111214,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-228.ec2.internal,}" Jul 06 20:42:57.601036 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.601014 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vm76b" Jul 06 20:42:57.702224 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.702192 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:42:57.703298 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.703278 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:42:57.703387 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.703312 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:42:57.703387 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.703323 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:42:57.703387 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.703350 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.710172 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.710150 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec203f93224e29c9e448da12179f9229-config\") pod \"kube-apiserver-proxy-ip-10-0-134-228.ec2.internal\" (UID: \"ec203f93224e29c9e448da12179f9229\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.710255 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.710188 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e7a7d2328f00d829639ef6b7a4ee8460-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal\" (UID: \"e7a7d2328f00d829639ef6b7a4ee8460\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.710255 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.710216 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7a7d2328f00d829639ef6b7a4ee8460-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal\" (UID: \"e7a7d2328f00d829639ef6b7a4ee8460\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.719273 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.719254 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.719327 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.719282 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-228.ec2.internal\": node \"ip-10-0-134-228.ec2.internal\" not found" Jul 06 20:42:57.810941 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.810842 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec203f93224e29c9e448da12179f9229-config\") pod \"kube-apiserver-proxy-ip-10-0-134-228.ec2.internal\" (UID: \"ec203f93224e29c9e448da12179f9229\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.810941 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.810890 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e7a7d2328f00d829639ef6b7a4ee8460-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal\" (UID: \"e7a7d2328f00d829639ef6b7a4ee8460\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.810941 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.810914 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7a7d2328f00d829639ef6b7a4ee8460-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal\" (UID: \"e7a7d2328f00d829639ef6b7a4ee8460\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.810941 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.810922 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ec203f93224e29c9e448da12179f9229-config\") pod \"kube-apiserver-proxy-ip-10-0-134-228.ec2.internal\" (UID: \"ec203f93224e29c9e448da12179f9229\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.811213 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.810963 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e7a7d2328f00d829639ef6b7a4ee8460-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal\" (UID: \"e7a7d2328f00d829639ef6b7a4ee8460\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.811213 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.811013 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e7a7d2328f00d829639ef6b7a4ee8460-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal\" (UID: \"e7a7d2328f00d829639ef6b7a4ee8460\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.826141 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.826113 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-228.ec2.internal\" not found" Jul 06 20:42:57.845223 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.845198 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.851132 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:57.851110 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-228.ec2.internal" Jul 06 20:42:57.926855 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:57.926814 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-228.ec2.internal\" not found" Jul 06 20:42:58.027294 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:58.027256 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-228.ec2.internal\" not found" Jul 06 20:42:58.128115 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:58.128005 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-228.ec2.internal\" not found" Jul 06 20:42:58.229203 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:58.229170 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-228.ec2.internal\" not found" Jul 06 20:42:58.243381 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:58.243353 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 20:42:58.329754 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:58.329715 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-228.ec2.internal\" not found" Jul 06 20:42:58.345458 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:58.345426 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 20:42:58.346506 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:58.346489 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientMemory" Jul 06 20:42:58.346641 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:58.346521 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 20:42:58.346641 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:58.346541 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeHasSufficientPID" Jul 06 20:42:58.430210 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:58.430180 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-228.ec2.internal\" not found" Jul 06 20:42:58.529230 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:58.529196 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec203f93224e29c9e448da12179f9229.slice/crio-cd3359276af5433d8512da0a7fe361cef053057061e7ca605a43649da464eb30 WatchSource:0}: Error finding container cd3359276af5433d8512da0a7fe361cef053057061e7ca605a43649da464eb30: Status 404 returned error can't find the container with id cd3359276af5433d8512da0a7fe361cef053057061e7ca605a43649da464eb30 Jul 06 20:42:58.529742 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:58.529715 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7a7d2328f00d829639ef6b7a4ee8460.slice/crio-93c65235bacb49394e6d06e9a9f90ce73487a049108241cce5ff2473928f1aa4 WatchSource:0}: Error finding container 93c65235bacb49394e6d06e9a9f90ce73487a049108241cce5ff2473928f1aa4: Status 404 returned error can't find the container with id 93c65235bacb49394e6d06e9a9f90ce73487a049108241cce5ff2473928f1aa4 Jul 06 20:42:58.530831 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:58.530812 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-228.ec2.internal\" not found" Jul 06 20:42:58.534848 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:58.534831 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:42:58.548763 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:58.548740 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:42:58.604986 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:58.604939 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 20:37:58 +0000 UTC" deadline="2028-01-04 18:35:41.205724145 +0000 UTC" Jul 06 20:42:58.604986 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:58.604978 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13125h52m42.600751648s" Jul 06 20:42:58.605283 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:58.605265 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:42:58.607474 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:58.607461 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal" Jul 06 20:42:58.642251 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:58.642224 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:42:58.643354 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:58.643339 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-228.ec2.internal" Jul 06 20:42:58.660418 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:58.660397 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 20:42:58.779140 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:58.779040 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:42:58.909820 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:58.909793 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 20:42:59.285883 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.285841 2579 apiserver.go:52] "Watching apiserver" Jul 06 20:42:59.294074 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.293934 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 20:42:59.297216 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.297180 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-2n66c","openshift-image-registry/node-ca-cwdkh","openshift-multus/multus-additional-cni-plugins-qlv6j","openshift-multus/multus-cs6cf","openshift-multus/network-metrics-daemon-4ktj2","openshift-network-diagnostics/network-check-target-trdb7","kube-system/global-pull-secret-syncer-n6q5c","kube-system/konnectivity-agent-hr6nx","kube-system/kube-apiserver-proxy-ip-10-0-134-228.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal","openshift-network-operator/iptables-alerter-hxxkh","openshift-ovn-kubernetes/ovnkube-node-ltvbf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t","openshift-cluster-node-tuning-operator/tuned-jvbmc"] Jul 06 20:42:59.298968 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.298936 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:42:59.299112 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:59.299057 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:42:59.300147 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.300126 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.301454 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.301389 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.302928 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.302905 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.304146 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.304125 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:42:59.304260 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:59.304213 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:42:59.305625 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.305598 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:42:59.305723 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:59.305670 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:42:59.306530 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.306489 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 20:42:59.307165 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.307143 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.307980 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.307964 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2n66c" Jul 06 20:42:59.308671 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.308015 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lb6ps\"" Jul 06 20:42:59.308671 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.308167 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 20:42:59.309085 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.308866 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 20:42:59.309189 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.309169 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-726bt\"" Jul 06 20:42:59.309255 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.309196 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-brfvk\"" Jul 06 20:42:59.309255 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.309225 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 20:42:59.309985 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.309478 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 20:42:59.309985 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.309495 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 20:42:59.309985 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.309499 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cwdkh" Jul 06 20:42:59.309985 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.309568 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 20:42:59.309985 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.309731 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 20:42:59.309985 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.309887 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 20:42:59.310964 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.310940 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hxxkh" Jul 06 20:42:59.312653 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.312634 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.314482 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.314463 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hr6nx" Jul 06 20:42:59.319172 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319137 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-sys-fs\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.319285 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319187 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/811731cd-7f4e-4167-bc87-26a30d2c5ab3-cnibin\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.319285 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319219 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw69l\" (UniqueName: \"kubernetes.io/projected/811731cd-7f4e-4167-bc87-26a30d2c5ab3-kube-api-access-rw69l\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.319285 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319247 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-sysctl-d\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.319285 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319272 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-multus-socket-dir-parent\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.319507 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319308 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-etc-kubernetes\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.319507 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319337 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 20:42:59.319507 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319336 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.319507 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-var-lib-kubelet\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.319507 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319470 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-var-lib-cni-multus\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.319507 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319496 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e33c4557-9986-481f-8088-cc0142641a11-serviceca\") pod \"node-ca-cwdkh\" (UID: \"e33c4557-9986-481f-8088-cc0142641a11\") " pod="openshift-image-registry/node-ca-cwdkh" Jul 06 20:42:59.319740 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319513 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:42:59.319740 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319537 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-device-dir\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.319740 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319563 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/811731cd-7f4e-4167-bc87-26a30d2c5ab3-cni-binary-copy\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.319740 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319601 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/811731cd-7f4e-4167-bc87-26a30d2c5ab3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.319740 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319638 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs\") pod \"network-metrics-daemon-4ktj2\" (UID: \"774becc8-6fe2-4ec6-aabf-a63925f4a0a6\") " pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:42:59.319740 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319664 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d58f76fe-a5fa-4b7d-874d-f4eb85335772-cni-binary-copy\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.319740 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319699 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e33c4557-9986-481f-8088-cc0142641a11-host\") pod \"node-ca-cwdkh\" (UID: \"e33c4557-9986-481f-8088-cc0142641a11\") " pod="openshift-image-registry/node-ca-cwdkh" Jul 06 20:42:59.319740 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319725 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-modprobe-d\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.320005 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-kubernetes\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.320005 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-host\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.320005 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319821 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 20:42:59.320005 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-var-lib-kubelet\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.320005 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319852 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-hostroot\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.320005 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319889 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-run-multus-certs\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.320005 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319937 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2731a50-9ac2-464f-93ff-1baaade87306-tmp-dir\") pod \"node-resolver-2n66c\" (UID: \"e2731a50-9ac2-464f-93ff-1baaade87306\") " pod="openshift-dns/node-resolver-2n66c" Jul 06 20:42:59.320005 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319964 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 20:42:59.320005 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319963 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e04d2210-8cbc-4669-a224-efaa7a105a01-kubelet-config\") pod \"global-pull-secret-syncer-n6q5c\" (UID: \"e04d2210-8cbc-4669-a224-efaa7a105a01\") " pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:42:59.320005 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320003 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-registration-dir\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.320371 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320031 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/811731cd-7f4e-4167-bc87-26a30d2c5ab3-system-cni-dir\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.320371 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320066 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-systemd\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.320371 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320093 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-run-k8s-cni-cncf-io\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.320371 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320151 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.320371 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.319966 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 20:42:59.320371 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320235 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-multus-conf-dir\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.320371 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320264 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p9pf\" (UniqueName: \"kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf\") pod \"network-check-target-trdb7\" (UID: \"4861643d-0031-4262-ae60-9b5b94bef4a9\") " pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:42:59.320371 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320306 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p52bf\" (UniqueName: \"kubernetes.io/projected/e2731a50-9ac2-464f-93ff-1baaade87306-kube-api-access-p52bf\") pod \"node-resolver-2n66c\" (UID: \"e2731a50-9ac2-464f-93ff-1baaade87306\") " pod="openshift-dns/node-resolver-2n66c" Jul 06 20:42:59.320371 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320337 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-run-netns\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.320832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320380 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lchj\" (UniqueName: \"kubernetes.io/projected/d58f76fe-a5fa-4b7d-874d-f4eb85335772-kube-api-access-7lchj\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.320832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320415 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/811731cd-7f4e-4167-bc87-26a30d2c5ab3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.320832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320464 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-sysctl-conf\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.320832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320513 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-run\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.320832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320545 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1f16363-8540-46b1-8d6d-8e2b60b309a8-tmp\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.320832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320575 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8zbgc\"" Jul 06 20:42:59.320832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320579 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-cnibin\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.320832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320606 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/811731cd-7f4e-4167-bc87-26a30d2c5ab3-os-release\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.320832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320650 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-tuned\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.320832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320677 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 20:42:59.320832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320680 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d58f76fe-a5fa-4b7d-874d-f4eb85335772-multus-daemon-config\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.320832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320721 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e2731a50-9ac2-464f-93ff-1baaade87306-hosts-file\") pod \"node-resolver-2n66c\" (UID: \"e2731a50-9ac2-464f-93ff-1baaade87306\") " pod="openshift-dns/node-resolver-2n66c" Jul 06 20:42:59.320832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320782 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hcbk\" (UniqueName: \"kubernetes.io/projected/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-kube-api-access-4hcbk\") pod \"network-metrics-daemon-4ktj2\" (UID: \"774becc8-6fe2-4ec6-aabf-a63925f4a0a6\") " pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:42:59.320832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320814 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-system-cni-dir\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.320832 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320840 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e04d2210-8cbc-4669-a224-efaa7a105a01-dbus\") pod \"global-pull-secret-syncer-n6q5c\" (UID: \"e04d2210-8cbc-4669-a224-efaa7a105a01\") " pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:42:59.321566 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320865 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-multus-cni-dir\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.321566 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320889 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 20:42:59.321566 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320893 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-socket-dir\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.321566 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320920 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-lib-modules\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.321566 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.320949 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ghrz\" (UniqueName: \"kubernetes.io/projected/e33c4557-9986-481f-8088-cc0142641a11-kube-api-access-7ghrz\") pod \"node-ca-cwdkh\" (UID: \"e33c4557-9986-481f-8088-cc0142641a11\") " pod="openshift-image-registry/node-ca-cwdkh" Jul 06 20:42:59.321566 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.321036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfcv4\" (UniqueName: \"kubernetes.io/projected/16d99c7a-7463-49e8-a179-95ade9a5f2b1-kube-api-access-pfcv4\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.321566 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.321062 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 20:42:59.321566 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.321068 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/811731cd-7f4e-4167-bc87-26a30d2c5ab3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.321566 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.321096 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret\") pod \"global-pull-secret-syncer-n6q5c\" (UID: \"e04d2210-8cbc-4669-a224-efaa7a105a01\") " pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:42:59.321566 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.321147 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-sysconfig\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.321566 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.321174 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-sys\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.321566 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.321200 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6h9c\" (UniqueName: \"kubernetes.io/projected/d1f16363-8540-46b1-8d6d-8e2b60b309a8-kube-api-access-d6h9c\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.321566 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.321228 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-os-release\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.321566 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.321253 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 20:42:59.321566 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.321257 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-var-lib-cni-bin\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.321566 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.321503 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:42:59.321566 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.321526 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mn4vh\"" Jul 06 20:42:59.322341 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.321786 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 20:42:59.322341 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.321833 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 20:42:59.322341 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.321880 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 20:42:59.322341 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.321834 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-j8cnd\"" Jul 06 20:42:59.322341 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.321963 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xdnx2\"" Jul 06 20:42:59.322341 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.322034 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 20:42:59.322341 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.322248 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cfvlx\"" Jul 06 20:42:59.322613 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.322437 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vf6km\"" Jul 06 20:42:59.322651 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.322621 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 20:42:59.322804 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.322767 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 20:42:59.322994 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.322975 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 20:42:59.325074 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.325051 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 20:42:59.331739 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.331718 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 20:42:59.343457 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.343424 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 20:42:59.407828 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.407799 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kv56k" Jul 06 20:42:59.409762 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.409670 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 20:42:59.422515 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422483 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-cnibin\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.422673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422531 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/811731cd-7f4e-4167-bc87-26a30d2c5ab3-os-release\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.422673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422556 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-tuned\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.422673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422585 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d58f76fe-a5fa-4b7d-874d-f4eb85335772-multus-daemon-config\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.422673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e2731a50-9ac2-464f-93ff-1baaade87306-hosts-file\") pod \"node-resolver-2n66c\" (UID: \"e2731a50-9ac2-464f-93ff-1baaade87306\") " pod="openshift-dns/node-resolver-2n66c" Jul 06 20:42:59.422673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422624 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hcbk\" (UniqueName: \"kubernetes.io/projected/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-kube-api-access-4hcbk\") pod \"network-metrics-daemon-4ktj2\" (UID: \"774becc8-6fe2-4ec6-aabf-a63925f4a0a6\") " pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:42:59.422673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422641 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-system-cni-dir\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.422673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e04d2210-8cbc-4669-a224-efaa7a105a01-dbus\") pod \"global-pull-secret-syncer-n6q5c\" (UID: \"e04d2210-8cbc-4669-a224-efaa7a105a01\") " pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:42:59.422673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422660 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-cnibin\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.422673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422675 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03e326a9-6711-4a8d-99ce-99bca6cf4448-konnectivity-ca\") pod \"konnectivity-agent-hr6nx\" (UID: \"03e326a9-6711-4a8d-99ce-99bca6cf4448\") " pod="kube-system/konnectivity-agent-hr6nx" Jul 06 20:42:59.423167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422674 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/811731cd-7f4e-4167-bc87-26a30d2c5ab3-os-release\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.423167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422693 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-cni-netd\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.423167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422734 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-system-cni-dir\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.423167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422741 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-multus-cni-dir\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.423167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422772 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-systemd-units\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.423167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422808 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.423167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422842 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-socket-dir\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.423167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422870 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-lib-modules\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.423167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422897 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ghrz\" (UniqueName: \"kubernetes.io/projected/e33c4557-9986-481f-8088-cc0142641a11-kube-api-access-7ghrz\") pod \"node-ca-cwdkh\" (UID: \"e33c4557-9986-481f-8088-cc0142641a11\") " pod="openshift-image-registry/node-ca-cwdkh" Jul 06 20:42:59.423167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422926 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfcv4\" (UniqueName: \"kubernetes.io/projected/16d99c7a-7463-49e8-a179-95ade9a5f2b1-kube-api-access-pfcv4\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.423167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422934 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e04d2210-8cbc-4669-a224-efaa7a105a01-dbus\") pod \"global-pull-secret-syncer-n6q5c\" (UID: \"e04d2210-8cbc-4669-a224-efaa7a105a01\") " pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:42:59.423167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422951 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-run-systemd\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.423167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.422989 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-log-socket\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.423167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423021 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-multus-cni-dir\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.423167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423020 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-ovnkube-config\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.423167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423053 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-env-overrides\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.423167 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/811731cd-7f4e-4167-bc87-26a30d2c5ab3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret\") pod \"global-pull-secret-syncer-n6q5c\" (UID: \"e04d2210-8cbc-4669-a224-efaa7a105a01\") " pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423157 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-ovn-node-metrics-cert\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423189 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-sysconfig\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423214 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-sys\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423226 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-lib-modules\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423242 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6h9c\" (UniqueName: \"kubernetes.io/projected/d1f16363-8540-46b1-8d6d-8e2b60b309a8-kube-api-access-d6h9c\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423298 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-os-release\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423326 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-var-lib-cni-bin\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423351 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423375 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d58f76fe-a5fa-4b7d-874d-f4eb85335772-multus-daemon-config\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423423 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-socket-dir\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423361 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-run-netns\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423599 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e2731a50-9ac2-464f-93ff-1baaade87306-hosts-file\") pod \"node-resolver-2n66c\" (UID: \"e2731a50-9ac2-464f-93ff-1baaade87306\") " pod="openshift-dns/node-resolver-2n66c" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423624 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-ovnkube-script-lib\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423689 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-sys-fs\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423730 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-sysconfig\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423723 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/811731cd-7f4e-4167-bc87-26a30d2c5ab3-cnibin\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.423993 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423755 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-sys\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.424865 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423769 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/811731cd-7f4e-4167-bc87-26a30d2c5ab3-cnibin\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.424865 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423778 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw69l\" (UniqueName: \"kubernetes.io/projected/811731cd-7f4e-4167-bc87-26a30d2c5ab3-kube-api-access-rw69l\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.424865 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:59.423860 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:42:59.424865 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.423879 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kv56k" Jul 06 20:42:59.424865 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:59.423919 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret podName:e04d2210-8cbc-4669-a224-efaa7a105a01 nodeName:}" failed. No retries permitted until 2026-07-06 20:42:59.923900239 +0000 UTC m=+4.012405291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret") pod "global-pull-secret-syncer-n6q5c" (UID: "e04d2210-8cbc-4669-a224-efaa7a105a01") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:42:59.424865 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424058 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-os-release\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.424865 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424059 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/811731cd-7f4e-4167-bc87-26a30d2c5ab3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.424865 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424081 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-sysctl-d\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.424865 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424111 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cafb342c-2194-450e-929d-4e0e4caac245-host-slash\") pod \"iptables-alerter-hxxkh\" (UID: \"cafb342c-2194-450e-929d-4e0e4caac245\") " pod="openshift-network-operator/iptables-alerter-hxxkh" Jul 06 20:42:59.424865 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424147 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-var-lib-cni-bin\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.424865 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424158 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-kubelet\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.424865 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424186 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-multus-socket-dir-parent\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.424865 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424212 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-etc-kubernetes\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.424865 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424247 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cafb342c-2194-450e-929d-4e0e4caac245-iptables-alerter-script\") pod \"iptables-alerter-hxxkh\" (UID: \"cafb342c-2194-450e-929d-4e0e4caac245\") " pod="openshift-network-operator/iptables-alerter-hxxkh" Jul 06 20:42:59.424865 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424258 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-sysctl-d\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.424865 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424279 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.424865 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424308 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-var-lib-kubelet\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.425753 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424321 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-sys-fs\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.425753 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424337 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-multus-socket-dir-parent\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.425753 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424388 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-var-lib-cni-multus\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.425753 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424408 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-etc-kubernetes\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.425753 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424346 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-var-lib-cni-multus\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.425753 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424449 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.425753 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e33c4557-9986-481f-8088-cc0142641a11-serviceca\") pod \"node-ca-cwdkh\" (UID: \"e33c4557-9986-481f-8088-cc0142641a11\") " pod="openshift-image-registry/node-ca-cwdkh" Jul 06 20:42:59.425753 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424499 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-var-lib-kubelet\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.425753 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424504 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnwqb\" (UniqueName: \"kubernetes.io/projected/cafb342c-2194-450e-929d-4e0e4caac245-kube-api-access-cnwqb\") pod \"iptables-alerter-hxxkh\" (UID: \"cafb342c-2194-450e-929d-4e0e4caac245\") " pod="openshift-network-operator/iptables-alerter-hxxkh" Jul 06 20:42:59.425753 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424540 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-node-log\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.425753 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424594 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-device-dir\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.425753 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424623 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/811731cd-7f4e-4167-bc87-26a30d2c5ab3-cni-binary-copy\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.425753 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424674 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/811731cd-7f4e-4167-bc87-26a30d2c5ab3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.425753 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424696 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-device-dir\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.425753 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424712 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs\") pod \"network-metrics-daemon-4ktj2\" (UID: \"774becc8-6fe2-4ec6-aabf-a63925f4a0a6\") " pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:42:59.425753 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424740 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d58f76fe-a5fa-4b7d-874d-f4eb85335772-cni-binary-copy\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.425753 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424768 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e33c4557-9986-481f-8088-cc0142641a11-host\") pod \"node-ca-cwdkh\" (UID: \"e33c4557-9986-481f-8088-cc0142641a11\") " pod="openshift-image-registry/node-ca-cwdkh" Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424794 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-slash\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424822 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-modprobe-d\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-kubernetes\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424878 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-host\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-var-lib-kubelet\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424932 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-hostroot\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424949 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e33c4557-9986-481f-8088-cc0142641a11-serviceca\") pod \"node-ca-cwdkh\" (UID: \"e33c4557-9986-481f-8088-cc0142641a11\") " pod="openshift-image-registry/node-ca-cwdkh" Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424958 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-run-multus-certs\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.424989 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2731a50-9ac2-464f-93ff-1baaade87306-tmp-dir\") pod \"node-resolver-2n66c\" (UID: \"e2731a50-9ac2-464f-93ff-1baaade87306\") " pod="openshift-dns/node-resolver-2n66c" Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425018 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e04d2210-8cbc-4669-a224-efaa7a105a01-kubelet-config\") pod \"global-pull-secret-syncer-n6q5c\" (UID: \"e04d2210-8cbc-4669-a224-efaa7a105a01\") " pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-registration-dir\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/811731cd-7f4e-4167-bc87-26a30d2c5ab3-system-cni-dir\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425100 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-systemd\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425116 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-modprobe-d\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425145 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-run-k8s-cni-cncf-io\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425176 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03e326a9-6711-4a8d-99ce-99bca6cf4448-agent-certs\") pod \"konnectivity-agent-hr6nx\" (UID: \"03e326a9-6711-4a8d-99ce-99bca6cf4448\") " pod="kube-system/konnectivity-agent-hr6nx" Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:59.425199 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:42:59.426644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425206 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-var-lib-openvswitch\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.429451 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425226 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/811731cd-7f4e-4167-bc87-26a30d2c5ab3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.429451 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425236 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-run-ovn\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.429451 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:59.425258 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs podName:774becc8-6fe2-4ec6-aabf-a63925f4a0a6 nodeName:}" failed. No retries permitted until 2026-07-06 20:42:59.925240953 +0000 UTC m=+4.013745974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs") pod "network-metrics-daemon-4ktj2" (UID: "774becc8-6fe2-4ec6-aabf-a63925f4a0a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:42:59.429451 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425319 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-host\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.429451 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425317 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-registration-dir\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.429451 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425362 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/811731cd-7f4e-4167-bc87-26a30d2c5ab3-system-cni-dir\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.429451 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425371 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-var-lib-kubelet\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.429451 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425413 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-hostroot\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.429451 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425424 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-run-k8s-cni-cncf-io\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.429451 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425455 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-systemd\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.429451 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425494 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-run-multus-certs\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.429451 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425550 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e33c4557-9986-481f-8088-cc0142641a11-host\") pod \"node-ca-cwdkh\" (UID: \"e33c4557-9986-481f-8088-cc0142641a11\") " pod="openshift-image-registry/node-ca-cwdkh" Jul 06 20:42:59.429451 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425663 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zprxq\" (UniqueName: \"kubernetes.io/projected/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-kube-api-access-zprxq\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.429451 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425696 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.429451 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-multus-conf-dir\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.429451 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425740 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d58f76fe-a5fa-4b7d-874d-f4eb85335772-cni-binary-copy\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.429451 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425754 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p9pf\" (UniqueName: \"kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf\") pod \"network-check-target-trdb7\" (UID: \"4861643d-0031-4262-ae60-9b5b94bef4a9\") " pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:42:59.430258 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425790 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p52bf\" (UniqueName: \"kubernetes.io/projected/e2731a50-9ac2-464f-93ff-1baaade87306-kube-api-access-p52bf\") pod \"node-resolver-2n66c\" (UID: \"e2731a50-9ac2-464f-93ff-1baaade87306\") " pod="openshift-dns/node-resolver-2n66c" Jul 06 20:42:59.430258 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425791 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/811731cd-7f4e-4167-bc87-26a30d2c5ab3-cni-binary-copy\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.430258 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425820 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-run-ovn-kubernetes\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.430258 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425846 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e04d2210-8cbc-4669-a224-efaa7a105a01-kubelet-config\") pod \"global-pull-secret-syncer-n6q5c\" (UID: \"e04d2210-8cbc-4669-a224-efaa7a105a01\") " pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:42:59.430258 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425848 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-cni-bin\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.430258 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425866 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-kubernetes\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.430258 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-run-netns\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.430258 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425936 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lchj\" (UniqueName: \"kubernetes.io/projected/d58f76fe-a5fa-4b7d-874d-f4eb85335772-kube-api-access-7lchj\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.430258 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425964 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/16d99c7a-7463-49e8-a179-95ade9a5f2b1-etc-selinux\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.430258 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425796 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2731a50-9ac2-464f-93ff-1baaade87306-tmp-dir\") pod \"node-resolver-2n66c\" (UID: \"e2731a50-9ac2-464f-93ff-1baaade87306\") " pod="openshift-dns/node-resolver-2n66c" Jul 06 20:42:59.430258 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.425978 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-etc-openvswitch\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.430258 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.426036 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-host-run-netns\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.430258 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.426036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-run-openvswitch\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.430258 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.426068 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d58f76fe-a5fa-4b7d-874d-f4eb85335772-multus-conf-dir\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.430258 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.426082 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/811731cd-7f4e-4167-bc87-26a30d2c5ab3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.430258 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.426135 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-sysctl-conf\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.430258 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.426163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-run\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.431008 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.426192 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1f16363-8540-46b1-8d6d-8e2b60b309a8-tmp\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.431008 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.426325 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-run\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.431008 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.426372 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-sysctl-conf\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.431008 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.426642 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/811731cd-7f4e-4167-bc87-26a30d2c5ab3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.431008 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.428821 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d1f16363-8540-46b1-8d6d-8e2b60b309a8-etc-tuned\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.431008 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.428967 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1f16363-8540-46b1-8d6d-8e2b60b309a8-tmp\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.431008 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.429659 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal" event={"ID":"e7a7d2328f00d829639ef6b7a4ee8460","Type":"ContainerStarted","Data":"93c65235bacb49394e6d06e9a9f90ce73487a049108241cce5ff2473928f1aa4"} Jul 06 20:42:59.434035 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.433964 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-228.ec2.internal" event={"ID":"ec203f93224e29c9e448da12179f9229","Type":"ContainerStarted","Data":"cd3359276af5433d8512da0a7fe361cef053057061e7ca605a43649da464eb30"} Jul 06 20:42:59.452827 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.452512 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw69l\" (UniqueName: \"kubernetes.io/projected/811731cd-7f4e-4167-bc87-26a30d2c5ab3-kube-api-access-rw69l\") pod \"multus-additional-cni-plugins-qlv6j\" (UID: \"811731cd-7f4e-4167-bc87-26a30d2c5ab3\") " pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.455561 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.455534 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ghrz\" (UniqueName: \"kubernetes.io/projected/e33c4557-9986-481f-8088-cc0142641a11-kube-api-access-7ghrz\") pod \"node-ca-cwdkh\" (UID: \"e33c4557-9986-481f-8088-cc0142641a11\") " pod="openshift-image-registry/node-ca-cwdkh" Jul 06 20:42:59.467471 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:59.467446 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:42:59.467471 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:59.467476 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:42:59.467665 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:59.467492 2579 projected.go:196] Error preparing data for projected volume kube-api-access-5p9pf for pod openshift-network-diagnostics/network-check-target-trdb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:42:59.467665 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:59.467588 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf podName:4861643d-0031-4262-ae60-9b5b94bef4a9 nodeName:}" failed. No retries permitted until 2026-07-06 20:42:59.967566246 +0000 UTC m=+4.056071281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5p9pf" (UniqueName: "kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf") pod "network-check-target-trdb7" (UID: "4861643d-0031-4262-ae60-9b5b94bef4a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:42:59.468644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.468618 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hcbk\" (UniqueName: \"kubernetes.io/projected/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-kube-api-access-4hcbk\") pod \"network-metrics-daemon-4ktj2\" (UID: \"774becc8-6fe2-4ec6-aabf-a63925f4a0a6\") " pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:42:59.470734 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.470710 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lchj\" (UniqueName: \"kubernetes.io/projected/d58f76fe-a5fa-4b7d-874d-f4eb85335772-kube-api-access-7lchj\") pod \"multus-cs6cf\" (UID: \"d58f76fe-a5fa-4b7d-874d-f4eb85335772\") " pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.473328 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.473306 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6h9c\" (UniqueName: \"kubernetes.io/projected/d1f16363-8540-46b1-8d6d-8e2b60b309a8-kube-api-access-d6h9c\") pod \"tuned-jvbmc\" (UID: \"d1f16363-8540-46b1-8d6d-8e2b60b309a8\") " pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.475172 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.475147 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p52bf\" (UniqueName: \"kubernetes.io/projected/e2731a50-9ac2-464f-93ff-1baaade87306-kube-api-access-p52bf\") pod \"node-resolver-2n66c\" (UID: \"e2731a50-9ac2-464f-93ff-1baaade87306\") " pod="openshift-dns/node-resolver-2n66c" Jul 06 20:42:59.477478 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.477452 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfcv4\" (UniqueName: \"kubernetes.io/projected/16d99c7a-7463-49e8-a179-95ade9a5f2b1-kube-api-access-pfcv4\") pod \"aws-ebs-csi-driver-node-fd46t\" (UID: \"16d99c7a-7463-49e8-a179-95ade9a5f2b1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.526463 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526424 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03e326a9-6711-4a8d-99ce-99bca6cf4448-konnectivity-ca\") pod \"konnectivity-agent-hr6nx\" (UID: \"03e326a9-6711-4a8d-99ce-99bca6cf4448\") " pod="kube-system/konnectivity-agent-hr6nx" Jul 06 20:42:59.526463 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-cni-netd\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.526673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526507 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-cni-netd\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.526673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526535 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-systemd-units\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.526673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526555 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.526673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526574 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-run-systemd\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.526673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526595 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-log-socket\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.526673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526612 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-systemd-units\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.526673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526632 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.526673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526633 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-run-systemd\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.526673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526620 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-ovnkube-config\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.526988 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526667 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-log-socket\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.526988 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526702 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-env-overrides\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.526988 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-ovn-node-metrics-cert\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.526988 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-run-netns\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.526988 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526786 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-ovnkube-script-lib\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.526988 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526822 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cafb342c-2194-450e-929d-4e0e4caac245-host-slash\") pod \"iptables-alerter-hxxkh\" (UID: \"cafb342c-2194-450e-929d-4e0e4caac245\") " pod="openshift-network-operator/iptables-alerter-hxxkh" Jul 06 20:42:59.526988 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-kubelet\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.526988 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526892 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cafb342c-2194-450e-929d-4e0e4caac245-host-slash\") pod \"iptables-alerter-hxxkh\" (UID: \"cafb342c-2194-450e-929d-4e0e4caac245\") " pod="openshift-network-operator/iptables-alerter-hxxkh" Jul 06 20:42:59.526988 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526835 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-run-netns\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.526988 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526949 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-kubelet\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.527480 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.526996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cafb342c-2194-450e-929d-4e0e4caac245-iptables-alerter-script\") pod \"iptables-alerter-hxxkh\" (UID: \"cafb342c-2194-450e-929d-4e0e4caac245\") " pod="openshift-network-operator/iptables-alerter-hxxkh" Jul 06 20:42:59.527480 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527038 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnwqb\" (UniqueName: \"kubernetes.io/projected/cafb342c-2194-450e-929d-4e0e4caac245-kube-api-access-cnwqb\") pod \"iptables-alerter-hxxkh\" (UID: \"cafb342c-2194-450e-929d-4e0e4caac245\") " pod="openshift-network-operator/iptables-alerter-hxxkh" Jul 06 20:42:59.527480 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527058 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/03e326a9-6711-4a8d-99ce-99bca6cf4448-konnectivity-ca\") pod \"konnectivity-agent-hr6nx\" (UID: \"03e326a9-6711-4a8d-99ce-99bca6cf4448\") " pod="kube-system/konnectivity-agent-hr6nx" Jul 06 20:42:59.527480 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-node-log\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.527480 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527146 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-slash\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.527480 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527190 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03e326a9-6711-4a8d-99ce-99bca6cf4448-agent-certs\") pod \"konnectivity-agent-hr6nx\" (UID: \"03e326a9-6711-4a8d-99ce-99bca6cf4448\") " pod="kube-system/konnectivity-agent-hr6nx" Jul 06 20:42:59.527480 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-var-lib-openvswitch\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.527480 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527256 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-ovnkube-config\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.527480 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527269 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-slash\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.527480 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-run-ovn\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.527480 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527324 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-node-log\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.527480 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527273 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-var-lib-openvswitch\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.527480 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527335 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zprxq\" (UniqueName: \"kubernetes.io/projected/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-kube-api-access-zprxq\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.527480 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527391 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-env-overrides\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.527480 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527456 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-run-ovn\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.528255 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527498 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-run-ovn-kubernetes\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.528255 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527588 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cafb342c-2194-450e-929d-4e0e4caac245-iptables-alerter-script\") pod \"iptables-alerter-hxxkh\" (UID: \"cafb342c-2194-450e-929d-4e0e4caac245\") " pod="openshift-network-operator/iptables-alerter-hxxkh" Jul 06 20:42:59.528255 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527627 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-run-ovn-kubernetes\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.528255 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-cni-bin\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.528255 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527678 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-etc-openvswitch\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.528255 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527698 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-host-cni-bin\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.528255 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-run-openvswitch\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.528255 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527735 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-etc-openvswitch\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.528255 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527771 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-run-openvswitch\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.528255 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.527868 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-ovnkube-script-lib\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.529576 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.529553 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-ovn-node-metrics-cert\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.529666 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.529630 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/03e326a9-6711-4a8d-99ce-99bca6cf4448-agent-certs\") pod \"konnectivity-agent-hr6nx\" (UID: \"03e326a9-6711-4a8d-99ce-99bca6cf4448\") " pod="kube-system/konnectivity-agent-hr6nx" Jul 06 20:42:59.543406 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.543348 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnwqb\" (UniqueName: \"kubernetes.io/projected/cafb342c-2194-450e-929d-4e0e4caac245-kube-api-access-cnwqb\") pod \"iptables-alerter-hxxkh\" (UID: \"cafb342c-2194-450e-929d-4e0e4caac245\") " pod="openshift-network-operator/iptables-alerter-hxxkh" Jul 06 20:42:59.543406 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.543348 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zprxq\" (UniqueName: \"kubernetes.io/projected/e8a0e0f0-fbb4-4da3-b737-76c41c58aabc-kube-api-access-zprxq\") pod \"ovnkube-node-ltvbf\" (UID: \"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc\") " pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.614534 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.614497 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" Jul 06 20:42:59.625729 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.625701 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qlv6j" Jul 06 20:42:59.627177 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:59.627086 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16d99c7a_7463_49e8_a179_95ade9a5f2b1.slice/crio-6690070c61c2cb3efb747a78584f8a38d86fd7b2cdfe8b1cf2afea059243fd56 WatchSource:0}: Error finding container 6690070c61c2cb3efb747a78584f8a38d86fd7b2cdfe8b1cf2afea059243fd56: Status 404 returned error can't find the container with id 6690070c61c2cb3efb747a78584f8a38d86fd7b2cdfe8b1cf2afea059243fd56 Jul 06 20:42:59.635708 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.635544 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cs6cf" Jul 06 20:42:59.635987 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:59.635906 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod811731cd_7f4e_4167_bc87_26a30d2c5ab3.slice/crio-3deff3f2145fd6b5ce692703a3a0eac50bed504a6c1dfa0b13b07d986c4dda81 WatchSource:0}: Error finding container 3deff3f2145fd6b5ce692703a3a0eac50bed504a6c1dfa0b13b07d986c4dda81: Status 404 returned error can't find the container with id 3deff3f2145fd6b5ce692703a3a0eac50bed504a6c1dfa0b13b07d986c4dda81 Jul 06 20:42:59.643225 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.643083 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" Jul 06 20:42:59.647779 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:59.647753 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd58f76fe_a5fa_4b7d_874d_f4eb85335772.slice/crio-531dd6b17c8fb42b93209aa2854950f01d3060204e869ad59ffb751d16665516 WatchSource:0}: Error finding container 531dd6b17c8fb42b93209aa2854950f01d3060204e869ad59ffb751d16665516: Status 404 returned error can't find the container with id 531dd6b17c8fb42b93209aa2854950f01d3060204e869ad59ffb751d16665516 Jul 06 20:42:59.650383 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.650360 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2n66c" Jul 06 20:42:59.654299 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:59.654273 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f16363_8540_46b1_8d6d_8e2b60b309a8.slice/crio-72323fba38dff50742e6ac969fc9cbbff7e466c45b47dee04321dbe05c64477f WatchSource:0}: Error finding container 72323fba38dff50742e6ac969fc9cbbff7e466c45b47dee04321dbe05c64477f: Status 404 returned error can't find the container with id 72323fba38dff50742e6ac969fc9cbbff7e466c45b47dee04321dbe05c64477f Jul 06 20:42:59.660137 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.660076 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cwdkh" Jul 06 20:42:59.660460 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:59.660436 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2731a50_9ac2_464f_93ff_1baaade87306.slice/crio-fca6df040ad1313a8308fa794692c3996c01ae1ee860ac68ba9b648f28cdb6cf WatchSource:0}: Error finding container fca6df040ad1313a8308fa794692c3996c01ae1ee860ac68ba9b648f28cdb6cf: Status 404 returned error can't find the container with id fca6df040ad1313a8308fa794692c3996c01ae1ee860ac68ba9b648f28cdb6cf Jul 06 20:42:59.669652 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:59.669625 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode33c4557_9986_481f_8088_cc0142641a11.slice/crio-72b1afbc45b290f5d72a75e9c4054294a6638360bf935e6883b7f30a6be0b370 WatchSource:0}: Error finding container 72b1afbc45b290f5d72a75e9c4054294a6638360bf935e6883b7f30a6be0b370: Status 404 returned error can't find the container with id 72b1afbc45b290f5d72a75e9c4054294a6638360bf935e6883b7f30a6be0b370 Jul 06 20:42:59.673306 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.673261 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hxxkh" Jul 06 20:42:59.681178 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.681151 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:42:59.686774 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:59.686746 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcafb342c_2194_450e_929d_4e0e4caac245.slice/crio-b8422922f15ab144968fe1ddbf16ab47d1d8f4a858e967b849be956e0b4140d2 WatchSource:0}: Error finding container b8422922f15ab144968fe1ddbf16ab47d1d8f4a858e967b849be956e0b4140d2: Status 404 returned error can't find the container with id b8422922f15ab144968fe1ddbf16ab47d1d8f4a858e967b849be956e0b4140d2 Jul 06 20:42:59.689333 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.689311 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hr6nx" Jul 06 20:42:59.695005 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:59.694982 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8a0e0f0_fbb4_4da3_b737_76c41c58aabc.slice/crio-d29237dd234d9df1ddf51a3e75940e12362829632c2bd736882fb9cb33e8186e WatchSource:0}: Error finding container d29237dd234d9df1ddf51a3e75940e12362829632c2bd736882fb9cb33e8186e: Status 404 returned error can't find the container with id d29237dd234d9df1ddf51a3e75940e12362829632c2bd736882fb9cb33e8186e Jul 06 20:42:59.699688 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:42:59.699667 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e326a9_6711_4a8d_99ce_99bca6cf4448.slice/crio-14c281a46c3f281badc93a6fb34191057f511e192019bd4d062aa71ed8970302 WatchSource:0}: Error finding container 14c281a46c3f281badc93a6fb34191057f511e192019bd4d062aa71ed8970302: Status 404 returned error can't find the container with id 14c281a46c3f281badc93a6fb34191057f511e192019bd4d062aa71ed8970302 Jul 06 20:42:59.930707 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.930611 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret\") pod \"global-pull-secret-syncer-n6q5c\" (UID: \"e04d2210-8cbc-4669-a224-efaa7a105a01\") " pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:42:59.930881 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:59.930753 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:42:59.930881 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:42:59.930728 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs\") pod \"network-metrics-daemon-4ktj2\" (UID: \"774becc8-6fe2-4ec6-aabf-a63925f4a0a6\") " pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:42:59.930881 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:59.930831 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret podName:e04d2210-8cbc-4669-a224-efaa7a105a01 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:00.930809284 +0000 UTC m=+5.019314306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret") pod "global-pull-secret-syncer-n6q5c" (UID: "e04d2210-8cbc-4669-a224-efaa7a105a01") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:42:59.931006 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:59.930910 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:42:59.931006 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:42:59.930992 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs podName:774becc8-6fe2-4ec6-aabf-a63925f4a0a6 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:00.930973512 +0000 UTC m=+5.019478546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs") pod "network-metrics-daemon-4ktj2" (UID: "774becc8-6fe2-4ec6-aabf-a63925f4a0a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:43:00.031861 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:00.031816 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p9pf\" (UniqueName: \"kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf\") pod \"network-check-target-trdb7\" (UID: \"4861643d-0031-4262-ae60-9b5b94bef4a9\") " pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:00.032035 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:00.031989 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:43:00.032035 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:00.032014 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:43:00.032035 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:00.032028 2579 projected.go:196] Error preparing data for projected volume kube-api-access-5p9pf for pod openshift-network-diagnostics/network-check-target-trdb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:43:00.032235 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:00.032113 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf podName:4861643d-0031-4262-ae60-9b5b94bef4a9 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:01.032090861 +0000 UTC m=+5.120595881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p9pf" (UniqueName: "kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf") pod "network-check-target-trdb7" (UID: "4861643d-0031-4262-ae60-9b5b94bef4a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:43:00.429024 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:00.428982 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:37:59 +0000 UTC" deadline="2028-04-07 08:32:47.403870166 +0000 UTC" Jul 06 20:43:00.429024 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:00.429023 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15371h49m46.974853086s" Jul 06 20:43:00.437307 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:00.437240 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2n66c" event={"ID":"e2731a50-9ac2-464f-93ff-1baaade87306","Type":"ContainerStarted","Data":"fca6df040ad1313a8308fa794692c3996c01ae1ee860ac68ba9b648f28cdb6cf"} Jul 06 20:43:00.438775 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:00.438732 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" event={"ID":"d1f16363-8540-46b1-8d6d-8e2b60b309a8","Type":"ContainerStarted","Data":"72323fba38dff50742e6ac969fc9cbbff7e466c45b47dee04321dbe05c64477f"} Jul 06 20:43:00.440558 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:00.440526 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cs6cf" event={"ID":"d58f76fe-a5fa-4b7d-874d-f4eb85335772","Type":"ContainerStarted","Data":"531dd6b17c8fb42b93209aa2854950f01d3060204e869ad59ffb751d16665516"} Jul 06 20:43:00.441983 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:00.441901 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qlv6j" event={"ID":"811731cd-7f4e-4167-bc87-26a30d2c5ab3","Type":"ContainerStarted","Data":"3deff3f2145fd6b5ce692703a3a0eac50bed504a6c1dfa0b13b07d986c4dda81"} Jul 06 20:43:00.443368 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:00.443338 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hr6nx" event={"ID":"03e326a9-6711-4a8d-99ce-99bca6cf4448","Type":"ContainerStarted","Data":"14c281a46c3f281badc93a6fb34191057f511e192019bd4d062aa71ed8970302"} Jul 06 20:43:00.444966 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:00.444872 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" event={"ID":"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc","Type":"ContainerStarted","Data":"d29237dd234d9df1ddf51a3e75940e12362829632c2bd736882fb9cb33e8186e"} Jul 06 20:43:00.447991 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:00.447704 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hxxkh" event={"ID":"cafb342c-2194-450e-929d-4e0e4caac245","Type":"ContainerStarted","Data":"b8422922f15ab144968fe1ddbf16ab47d1d8f4a858e967b849be956e0b4140d2"} Jul 06 20:43:00.449891 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:00.449861 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" event={"ID":"16d99c7a-7463-49e8-a179-95ade9a5f2b1","Type":"ContainerStarted","Data":"6690070c61c2cb3efb747a78584f8a38d86fd7b2cdfe8b1cf2afea059243fd56"} Jul 06 20:43:00.451500 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:00.451448 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cwdkh" event={"ID":"e33c4557-9986-481f-8088-cc0142641a11","Type":"ContainerStarted","Data":"72b1afbc45b290f5d72a75e9c4054294a6638360bf935e6883b7f30a6be0b370"} Jul 06 20:43:00.940469 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:00.940423 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs\") pod \"network-metrics-daemon-4ktj2\" (UID: \"774becc8-6fe2-4ec6-aabf-a63925f4a0a6\") " pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:00.940688 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:00.940523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret\") pod \"global-pull-secret-syncer-n6q5c\" (UID: \"e04d2210-8cbc-4669-a224-efaa7a105a01\") " pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:00.940688 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:00.940661 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:43:00.940688 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:00.940668 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:43:00.940874 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:00.940727 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret podName:e04d2210-8cbc-4669-a224-efaa7a105a01 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:02.940708901 +0000 UTC m=+7.029213922 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret") pod "global-pull-secret-syncer-n6q5c" (UID: "e04d2210-8cbc-4669-a224-efaa7a105a01") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:43:00.940874 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:00.940747 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs podName:774becc8-6fe2-4ec6-aabf-a63925f4a0a6 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:02.94073745 +0000 UTC m=+7.029242473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs") pod "network-metrics-daemon-4ktj2" (UID: "774becc8-6fe2-4ec6-aabf-a63925f4a0a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:43:01.041728 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:01.041687 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p9pf\" (UniqueName: \"kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf\") pod \"network-check-target-trdb7\" (UID: \"4861643d-0031-4262-ae60-9b5b94bef4a9\") " pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:01.041915 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:01.041883 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:43:01.041915 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:01.041908 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:43:01.042053 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:01.041921 2579 projected.go:196] Error preparing data for projected volume kube-api-access-5p9pf for pod openshift-network-diagnostics/network-check-target-trdb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:43:01.042053 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:01.041987 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf podName:4861643d-0031-4262-ae60-9b5b94bef4a9 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:03.041969211 +0000 UTC m=+7.130474238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p9pf" (UniqueName: "kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf") pod "network-check-target-trdb7" (UID: "4861643d-0031-4262-ae60-9b5b94bef4a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:43:01.422613 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:01.422532 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:01.422770 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:01.422663 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:43:01.423146 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:01.423110 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:01.423284 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:01.423241 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:43:01.423357 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:01.423316 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:01.423430 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:01.423409 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:43:01.430253 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:01.430201 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 20:37:59 +0000 UTC" deadline="2028-01-11 17:29:40.374840687 +0000 UTC" Jul 06 20:43:01.430253 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:01.430233 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13292h46m38.944612427s" Jul 06 20:43:02.961342 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:02.960391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret\") pod \"global-pull-secret-syncer-n6q5c\" (UID: \"e04d2210-8cbc-4669-a224-efaa7a105a01\") " pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:02.961342 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:02.960466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs\") pod \"network-metrics-daemon-4ktj2\" (UID: \"774becc8-6fe2-4ec6-aabf-a63925f4a0a6\") " pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:02.961342 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:02.960650 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:43:02.961342 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:02.960725 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs podName:774becc8-6fe2-4ec6-aabf-a63925f4a0a6 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:06.960704609 +0000 UTC m=+11.049209642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs") pod "network-metrics-daemon-4ktj2" (UID: "774becc8-6fe2-4ec6-aabf-a63925f4a0a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:43:02.961342 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:02.961221 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:43:02.961342 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:02.961294 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret podName:e04d2210-8cbc-4669-a224-efaa7a105a01 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:06.961275975 +0000 UTC m=+11.049781006 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret") pod "global-pull-secret-syncer-n6q5c" (UID: "e04d2210-8cbc-4669-a224-efaa7a105a01") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:43:03.060983 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:03.060940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p9pf\" (UniqueName: \"kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf\") pod \"network-check-target-trdb7\" (UID: \"4861643d-0031-4262-ae60-9b5b94bef4a9\") " pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:03.061221 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:03.061154 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:43:03.061221 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:03.061183 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:43:03.061221 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:03.061203 2579 projected.go:196] Error preparing data for projected volume kube-api-access-5p9pf for pod openshift-network-diagnostics/network-check-target-trdb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:43:03.061419 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:03.061297 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf podName:4861643d-0031-4262-ae60-9b5b94bef4a9 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:07.061276092 +0000 UTC m=+11.149781113 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p9pf" (UniqueName: "kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf") pod "network-check-target-trdb7" (UID: "4861643d-0031-4262-ae60-9b5b94bef4a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:43:03.421113 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:03.420194 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:03.421113 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:03.420337 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:43:03.421113 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:03.420804 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:03.421113 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:03.420962 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:43:03.421725 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:03.421560 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:03.421725 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:03.421685 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:43:05.421312 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:05.421281 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:05.421775 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:05.421326 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:05.421775 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:05.421287 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:05.421775 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:05.421455 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:43:05.421775 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:05.421574 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:43:05.421775 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:05.421678 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:43:06.994091 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:06.993941 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret\") pod \"global-pull-secret-syncer-n6q5c\" (UID: \"e04d2210-8cbc-4669-a224-efaa7a105a01\") " pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:06.994091 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:06.994008 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs\") pod \"network-metrics-daemon-4ktj2\" (UID: \"774becc8-6fe2-4ec6-aabf-a63925f4a0a6\") " pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:06.994581 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:06.994167 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:43:06.994581 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:06.994226 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs podName:774becc8-6fe2-4ec6-aabf-a63925f4a0a6 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:14.994207562 +0000 UTC m=+19.082712582 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs") pod "network-metrics-daemon-4ktj2" (UID: "774becc8-6fe2-4ec6-aabf-a63925f4a0a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:43:06.994581 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:06.994540 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:43:06.994737 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:06.994590 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret podName:e04d2210-8cbc-4669-a224-efaa7a105a01 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:14.994579331 +0000 UTC m=+19.083084346 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret") pod "global-pull-secret-syncer-n6q5c" (UID: "e04d2210-8cbc-4669-a224-efaa7a105a01") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:43:07.095405 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:07.094809 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p9pf\" (UniqueName: \"kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf\") pod \"network-check-target-trdb7\" (UID: \"4861643d-0031-4262-ae60-9b5b94bef4a9\") " pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:07.095405 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:07.094973 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:43:07.095405 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:07.094994 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:43:07.095405 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:07.095006 2579 projected.go:196] Error preparing data for projected volume kube-api-access-5p9pf for pod openshift-network-diagnostics/network-check-target-trdb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:43:07.095405 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:07.095076 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf podName:4861643d-0031-4262-ae60-9b5b94bef4a9 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:15.095058986 +0000 UTC m=+19.183564016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p9pf" (UniqueName: "kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf") pod "network-check-target-trdb7" (UID: "4861643d-0031-4262-ae60-9b5b94bef4a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:43:07.425493 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:07.425420 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:07.425783 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:07.425758 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:43:07.425893 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:07.425526 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:07.426067 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:07.426032 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:43:07.426173 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:07.425486 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:07.426323 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:07.426294 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:43:09.423620 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:09.423588 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:09.424077 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:09.423703 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:09.424077 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:09.423715 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:43:09.424077 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:09.423831 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:43:09.424077 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:09.423879 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:09.424077 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:09.423986 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:43:11.420073 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:11.419843 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:11.420505 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:11.419843 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:11.420505 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:11.420175 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:43:11.420505 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:11.420258 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:43:11.420505 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:11.419914 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:11.420505 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:11.420352 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:43:11.483277 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:11.483240 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" event={"ID":"d1f16363-8540-46b1-8d6d-8e2b60b309a8","Type":"ContainerStarted","Data":"b0aad55f9bdc16a1e1f43d61d3082238b742c67b7ee63933623a77331b81a32f"} Jul 06 20:43:11.486085 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:11.486031 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-228.ec2.internal" event={"ID":"ec203f93224e29c9e448da12179f9229","Type":"ContainerStarted","Data":"aa762f7505bbe5cc8597ea8944913d75105662ea02a313fc0d038ea3c1779daf"} Jul 06 20:43:11.510642 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:11.510586 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jvbmc" podStartSLOduration=2.229237582 podStartE2EDuration="13.510566682s" totalImagesPullingTime="11.2813291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:11.510290407 +0000 UTC m=+15.598795446" watchObservedRunningTime="2026-07-06 20:43:11.510566682 +0000 UTC m=+15.599071721" Jul 06 20:43:11.529743 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:11.529692 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-228.ec2.internal" podStartSLOduration=12.529672009 podStartE2EDuration="12.529672009s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:11.529514879 +0000 UTC m=+15.618019917" watchObservedRunningTime="2026-07-06 20:43:11.529672009 +0000 UTC m=+15.618177047" Jul 06 20:43:12.489412 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:12.489373 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hr6nx" event={"ID":"03e326a9-6711-4a8d-99ce-99bca6cf4448","Type":"ContainerStarted","Data":"a79711bc6940f91b2e9f2892df1471d39b88d2c481dc8fbb2f66379316424326"} Jul 06 20:43:12.491220 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:12.491188 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hxxkh" event={"ID":"cafb342c-2194-450e-929d-4e0e4caac245","Type":"ContainerStarted","Data":"b8687123761b3a8c78194235f671474ec6f0d08d307c603d24b65c8359adc83e"} Jul 06 20:43:12.492813 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:12.492778 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" event={"ID":"16d99c7a-7463-49e8-a179-95ade9a5f2b1","Type":"ContainerStarted","Data":"54d9624b921ed293e68aad9596caca61f142e976c08d6af522f241d2606c0c1c"} Jul 06 20:43:12.494346 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:12.494313 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cwdkh" event={"ID":"e33c4557-9986-481f-8088-cc0142641a11","Type":"ContainerStarted","Data":"e81148988c7d57e21bdca2ecdaf6f65634c5cb6f823819d71bd4832466da5d10"} Jul 06 20:43:12.495797 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:12.495762 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2n66c" event={"ID":"e2731a50-9ac2-464f-93ff-1baaade87306","Type":"ContainerStarted","Data":"bc3c5ee1aa394a90e38dde44b5af4582505142e75d982e758c3c8e34fe981821"} Jul 06 20:43:12.497346 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:12.497322 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qlv6j" event={"ID":"811731cd-7f4e-4167-bc87-26a30d2c5ab3","Type":"ContainerStarted","Data":"b2ce3f5ef502062dbb15fe6125227a7c9391afa76c88dc45aa9fc1b76dec8a1c"} Jul 06 20:43:12.498878 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:12.498854 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal" event={"ID":"e7a7d2328f00d829639ef6b7a4ee8460","Type":"ContainerStarted","Data":"053ef5fc9b1df0d73af78035d992f8e4ffc996e38fcc3ce9f47f044ff4007ce9"} Jul 06 20:43:12.518809 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:12.518765 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hr6nx" podStartSLOduration=3.280888219 podStartE2EDuration="14.518752491s" totalImagesPullingTime="11.237864272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:12.518276191 +0000 UTC m=+16.606781241" watchObservedRunningTime="2026-07-06 20:43:12.518752491 +0000 UTC m=+16.607257528" Jul 06 20:43:12.547323 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:12.547257 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2n66c" podStartSLOduration=3.271985076 podStartE2EDuration="14.54723753s" totalImagesPullingTime="11.275252454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:12.546931686 +0000 UTC m=+16.635436725" watchObservedRunningTime="2026-07-06 20:43:12.54723753 +0000 UTC m=+16.635742568" Jul 06 20:43:12.568091 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:12.568023 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cwdkh" podStartSLOduration=3.307166288 podStartE2EDuration="14.568009052s" totalImagesPullingTime="11.260842764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:12.567416569 +0000 UTC m=+16.655921604" watchObservedRunningTime="2026-07-06 20:43:12.568009052 +0000 UTC m=+16.656514090" Jul 06 20:43:12.606893 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:12.606842 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hxxkh" podStartSLOduration=3.353472309 podStartE2EDuration="14.606825842s" totalImagesPullingTime="11.253353533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:12.586691095 +0000 UTC m=+16.675196134" watchObservedRunningTime="2026-07-06 20:43:12.606825842 +0000 UTC m=+16.695330882" Jul 06 20:43:13.419916 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:13.419877 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:13.420098 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:13.419929 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:13.420098 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:13.420003 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:43:13.420098 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:13.419877 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:13.420259 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:13.420126 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:43:13.420259 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:13.420212 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:43:15.055291 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:15.055250 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs\") pod \"network-metrics-daemon-4ktj2\" (UID: \"774becc8-6fe2-4ec6-aabf-a63925f4a0a6\") " pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:15.055822 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:15.055342 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret\") pod \"global-pull-secret-syncer-n6q5c\" (UID: \"e04d2210-8cbc-4669-a224-efaa7a105a01\") " pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:15.055822 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:15.055427 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:43:15.055822 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:15.055450 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:43:15.055822 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:15.055509 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret podName:e04d2210-8cbc-4669-a224-efaa7a105a01 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:31.055489564 +0000 UTC m=+35.143994580 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret") pod "global-pull-secret-syncer-n6q5c" (UID: "e04d2210-8cbc-4669-a224-efaa7a105a01") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:43:15.055822 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:15.055525 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs podName:774becc8-6fe2-4ec6-aabf-a63925f4a0a6 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:31.055518077 +0000 UTC m=+35.144023092 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs") pod "network-metrics-daemon-4ktj2" (UID: "774becc8-6fe2-4ec6-aabf-a63925f4a0a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:43:15.156132 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:15.156093 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p9pf\" (UniqueName: \"kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf\") pod \"network-check-target-trdb7\" (UID: \"4861643d-0031-4262-ae60-9b5b94bef4a9\") " pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:15.156289 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:15.156254 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:43:15.156289 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:15.156275 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:43:15.156289 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:15.156289 2579 projected.go:196] Error preparing data for projected volume kube-api-access-5p9pf for pod openshift-network-diagnostics/network-check-target-trdb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:43:15.156400 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:15.156351 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf podName:4861643d-0031-4262-ae60-9b5b94bef4a9 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:31.156330302 +0000 UTC m=+35.244835318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p9pf" (UniqueName: "kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf") pod "network-check-target-trdb7" (UID: "4861643d-0031-4262-ae60-9b5b94bef4a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:43:15.318298 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:15.318212 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hr6nx" Jul 06 20:43:15.318900 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:15.318879 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hr6nx" Jul 06 20:43:15.419422 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:15.419382 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:15.419422 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:15.419421 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:15.419655 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:15.419516 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:43:15.419858 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:15.419837 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:15.419988 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:15.419951 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:43:15.420080 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:15.420018 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:43:15.506471 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:15.506432 2579 generic.go:356] "Generic (PLEG): container finished" podID="811731cd-7f4e-4167-bc87-26a30d2c5ab3" containerID="b2ce3f5ef502062dbb15fe6125227a7c9391afa76c88dc45aa9fc1b76dec8a1c" exitCode=0 Jul 06 20:43:15.506641 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:15.506526 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qlv6j" event={"ID":"811731cd-7f4e-4167-bc87-26a30d2c5ab3","Type":"ContainerDied","Data":"b2ce3f5ef502062dbb15fe6125227a7c9391afa76c88dc45aa9fc1b76dec8a1c"} Jul 06 20:43:15.509137 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:15.508249 2579 generic.go:356] "Generic (PLEG): container finished" podID="e7a7d2328f00d829639ef6b7a4ee8460" containerID="053ef5fc9b1df0d73af78035d992f8e4ffc996e38fcc3ce9f47f044ff4007ce9" exitCode=0 Jul 06 20:43:15.509137 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:15.508282 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal" event={"ID":"e7a7d2328f00d829639ef6b7a4ee8460","Type":"ContainerDied","Data":"053ef5fc9b1df0d73af78035d992f8e4ffc996e38fcc3ce9f47f044ff4007ce9"} Jul 06 20:43:15.509137 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:15.508611 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hr6nx" Jul 06 20:43:15.509362 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:15.509203 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hr6nx" Jul 06 20:43:17.420692 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:17.420630 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:17.421444 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:17.420740 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:17.421444 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:17.420735 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:43:17.421444 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:17.420846 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:43:17.421444 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:17.420859 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:17.421444 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:17.420966 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:43:19.419968 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:19.419929 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:19.420517 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:19.419984 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:19.420517 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:19.419929 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:19.420517 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:19.420079 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:43:19.420517 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:19.420158 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:43:19.420517 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:19.420252 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:43:20.284668 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:20.284467 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 20:43:20.391370 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:20.391270 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T20:43:20.284662955Z","UUID":"0c5c1530-8545-4e31-a39d-131a25fb97ac","Handler":null,"Name":"","Endpoint":""} Jul 06 20:43:20.392952 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:20.392935 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 20:43:20.393071 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:20.392980 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 20:43:20.520099 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:20.519998 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cs6cf" event={"ID":"d58f76fe-a5fa-4b7d-874d-f4eb85335772","Type":"ContainerStarted","Data":"7d6602f8961c6c653a7bd619d0d1fefb9d5b8792109f11451fb1541583cd5798"} Jul 06 20:43:20.525495 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:20.525461 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal" event={"ID":"e7a7d2328f00d829639ef6b7a4ee8460","Type":"ContainerStarted","Data":"48f25a01139cd7846e2c3e07484ae1f430a00227d7a537c2703209dd7f2c7d83"} Jul 06 20:43:20.527855 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:20.527835 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltvbf_e8a0e0f0-fbb4-4da3-b737-76c41c58aabc/ovn-acl-logging/0.log" Jul 06 20:43:20.528189 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:20.528170 2579 generic.go:356] "Generic (PLEG): container finished" podID="e8a0e0f0-fbb4-4da3-b737-76c41c58aabc" containerID="de174f7c48dfed268072b3e1190149fcbc6e0a144bbdbca83fb5f16ac5454bef" exitCode=1 Jul 06 20:43:20.528288 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:20.528232 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" event={"ID":"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc","Type":"ContainerStarted","Data":"ed219d2e58c32e1b669e202adbb84f2c3d91b729b92dac4c790fba6d3a46a111"} Jul 06 20:43:20.528361 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:20.528307 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" event={"ID":"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc","Type":"ContainerStarted","Data":"9cff170c01e99dbf48b276780f81595d011d99188029c4acf374007be2213efc"} Jul 06 20:43:20.528416 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:20.528362 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" event={"ID":"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc","Type":"ContainerDied","Data":"de174f7c48dfed268072b3e1190149fcbc6e0a144bbdbca83fb5f16ac5454bef"} Jul 06 20:43:20.528416 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:20.528409 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" event={"ID":"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc","Type":"ContainerStarted","Data":"6b9293371f5d9cc95cb5de09e12136a68223acc7fb0b7d735da7a1e37c000cb5"} Jul 06 20:43:20.530064 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:20.530022 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" event={"ID":"16d99c7a-7463-49e8-a179-95ade9a5f2b1","Type":"ContainerStarted","Data":"cc265c670d260fb1bc0dcd7f220b50cc697ace73556437c9f7bb2358655046e2"} Jul 06 20:43:20.607525 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:20.607480 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cs6cf" podStartSLOduration=2.303865029 podStartE2EDuration="22.607459892s" totalImagesPullingTime="20.303594863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:20.568210956 +0000 UTC m=+24.656715993" watchObservedRunningTime="2026-07-06 20:43:20.607459892 +0000 UTC m=+24.695964929" Jul 06 20:43:20.607777 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:20.607753 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-228.ec2.internal" podStartSLOduration=22.607746692 podStartE2EDuration="22.607746692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:42:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:20.60755309 +0000 UTC m=+24.696058130" watchObservedRunningTime="2026-07-06 20:43:20.607746692 +0000 UTC m=+24.696251729" Jul 06 20:43:21.419559 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:21.419373 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:21.419715 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:21.419373 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:21.419715 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:21.419659 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:43:21.419715 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:21.419412 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:21.419871 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:21.419740 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:43:21.419871 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:21.419857 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:43:21.534608 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:21.534584 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltvbf_e8a0e0f0-fbb4-4da3-b737-76c41c58aabc/ovn-acl-logging/0.log" Jul 06 20:43:21.535062 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:21.535022 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" event={"ID":"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc","Type":"ContainerStarted","Data":"793d81f58dc7f0441c9b4101d4ffd9ace75b11908029df239f162a4f9e493202"} Jul 06 20:43:21.535144 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:21.535124 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" event={"ID":"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc","Type":"ContainerStarted","Data":"b358693ce788735906f48bf7d8087dfc9a215feede5114b7bdb6be55d03031ff"} Jul 06 20:43:21.537151 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:21.537127 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" event={"ID":"16d99c7a-7463-49e8-a179-95ade9a5f2b1","Type":"ContainerStarted","Data":"4992c193efb38a2925a4de17a180457b428ec2e890ec0695cd92503f7a46cc5a"} Jul 06 20:43:23.419805 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:23.419773 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:23.420291 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:23.419774 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:23.420291 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:23.419882 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:43:23.420291 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:23.419894 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:23.420291 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:23.420000 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:43:23.420291 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:23.420107 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:43:23.544320 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:23.544297 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltvbf_e8a0e0f0-fbb4-4da3-b737-76c41c58aabc/ovn-acl-logging/0.log" Jul 06 20:43:23.544756 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:23.544734 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" event={"ID":"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc","Type":"ContainerStarted","Data":"66dec5f3cce8dc53aebb1e1d69acba1dd63fac480071ce1402a6464cc927e5d0"} Jul 06 20:43:25.419995 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:25.419964 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:25.420606 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:25.419964 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:25.420606 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:25.420094 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:25.420606 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:25.420100 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:43:25.420606 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:25.420190 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:43:25.420606 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:25.420271 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:43:26.555485 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:26.555272 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltvbf_e8a0e0f0-fbb4-4da3-b737-76c41c58aabc/ovn-acl-logging/0.log" Jul 06 20:43:26.556008 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:26.555846 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" event={"ID":"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc","Type":"ContainerStarted","Data":"afdfcd933679a9fe430f43b812c981dd203a781f656fcd62f9f4de53b5b7ca7b"} Jul 06 20:43:26.556174 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:26.556133 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:43:26.556306 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:26.556247 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:43:26.556376 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:26.556309 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:43:26.556434 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:26.556417 2579 scope.go:117] "RemoveContainer" containerID="de174f7c48dfed268072b3e1190149fcbc6e0a144bbdbca83fb5f16ac5454bef" Jul 06 20:43:26.575661 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:26.575635 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:43:26.576252 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:26.576230 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:43:26.602850 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:26.602802 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fd46t" podStartSLOduration=8.295919738 podStartE2EDuration="28.602786656s" totalImagesPullingTime="20.306866918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:42:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:21.571145912 +0000 UTC m=+25.659650949" watchObservedRunningTime="2026-07-06 20:43:26.602786656 +0000 UTC m=+30.691291694" Jul 06 20:43:27.420075 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:27.419969 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:27.420075 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:27.420062 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:43:27.420315 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:27.420155 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:27.420315 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:27.420268 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:43:27.420426 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:27.420361 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:27.420480 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:27.420458 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:43:27.561092 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:27.561029 2579 generic.go:356] "Generic (PLEG): container finished" podID="811731cd-7f4e-4167-bc87-26a30d2c5ab3" containerID="b5dfb6766927b7d30f5b7c189dbb6938dc2ec8f219cf1d30f91d1b1fadc15a71" exitCode=0 Jul 06 20:43:27.561570 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:27.561145 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qlv6j" event={"ID":"811731cd-7f4e-4167-bc87-26a30d2c5ab3","Type":"ContainerDied","Data":"b5dfb6766927b7d30f5b7c189dbb6938dc2ec8f219cf1d30f91d1b1fadc15a71"} Jul 06 20:43:27.576391 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:27.576370 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltvbf_e8a0e0f0-fbb4-4da3-b737-76c41c58aabc/ovn-acl-logging/0.log" Jul 06 20:43:27.576781 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:27.576758 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" event={"ID":"e8a0e0f0-fbb4-4da3-b737-76c41c58aabc","Type":"ContainerStarted","Data":"f0d0861cda71e53e53b2b44a84ac39251d8119e6ec9ca714c531a13142e46e2a"} Jul 06 20:43:28.823613 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:28.823449 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" podStartSLOduration=10.523158552 podStartE2EDuration="30.823432223s" totalImagesPullingTime="20.300273671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:27.651821507 +0000 UTC m=+31.740326544" watchObservedRunningTime="2026-07-06 20:43:28.823432223 +0000 UTC m=+32.911937629" Jul 06 20:43:28.824011 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:28.823863 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-trdb7"] Jul 06 20:43:28.824011 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:28.823998 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:28.824143 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:28.824122 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:43:28.835921 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:28.835890 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n6q5c"] Jul 06 20:43:28.836109 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:28.836018 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:28.836171 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:28.836134 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:43:28.838207 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:28.838178 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4ktj2"] Jul 06 20:43:28.838359 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:28.838292 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:28.838437 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:28.838412 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:43:29.583797 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:29.583766 2579 generic.go:356] "Generic (PLEG): container finished" podID="811731cd-7f4e-4167-bc87-26a30d2c5ab3" containerID="b7f8d05875217be59e4a33501787d66f5d75f9106f53ce153d8cb5fa8cca6888" exitCode=0 Jul 06 20:43:29.583940 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:29.583822 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qlv6j" event={"ID":"811731cd-7f4e-4167-bc87-26a30d2c5ab3","Type":"ContainerDied","Data":"b7f8d05875217be59e4a33501787d66f5d75f9106f53ce153d8cb5fa8cca6888"} Jul 06 20:43:30.420238 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:30.420054 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:30.420658 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:30.420058 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:30.420658 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:30.420351 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:43:30.420658 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:30.420061 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:30.420658 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:30.420419 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:43:30.420658 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:30.420465 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:43:30.587967 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:30.587882 2579 generic.go:356] "Generic (PLEG): container finished" podID="811731cd-7f4e-4167-bc87-26a30d2c5ab3" containerID="1f2424c054e77f46d9f531b317df415b78b364932a1dceafff19ac382019411d" exitCode=0 Jul 06 20:43:30.587967 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:30.587954 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qlv6j" event={"ID":"811731cd-7f4e-4167-bc87-26a30d2c5ab3","Type":"ContainerDied","Data":"1f2424c054e77f46d9f531b317df415b78b364932a1dceafff19ac382019411d"} Jul 06 20:43:31.079347 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:31.079262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret\") pod \"global-pull-secret-syncer-n6q5c\" (UID: \"e04d2210-8cbc-4669-a224-efaa7a105a01\") " pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:31.079347 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:31.079313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs\") pod \"network-metrics-daemon-4ktj2\" (UID: \"774becc8-6fe2-4ec6-aabf-a63925f4a0a6\") " pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:31.079505 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:31.079405 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 20:43:31.079505 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:31.079413 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:43:31.079505 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:31.079468 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs podName:774becc8-6fe2-4ec6-aabf-a63925f4a0a6 nodeName:}" failed. No retries permitted until 2026-07-06 20:44:03.079453275 +0000 UTC m=+67.167958291 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs") pod "network-metrics-daemon-4ktj2" (UID: "774becc8-6fe2-4ec6-aabf-a63925f4a0a6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 20:43:31.079505 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:31.079481 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret podName:e04d2210-8cbc-4669-a224-efaa7a105a01 nodeName:}" failed. No retries permitted until 2026-07-06 20:44:03.079475544 +0000 UTC m=+67.167980565 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret") pod "global-pull-secret-syncer-n6q5c" (UID: "e04d2210-8cbc-4669-a224-efaa7a105a01") : object "kube-system"/"original-pull-secret" not registered Jul 06 20:43:31.180097 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:31.180066 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p9pf\" (UniqueName: \"kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf\") pod \"network-check-target-trdb7\" (UID: \"4861643d-0031-4262-ae60-9b5b94bef4a9\") " pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:31.180235 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:31.180192 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 20:43:31.180235 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:31.180208 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 20:43:31.180235 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:31.180216 2579 projected.go:196] Error preparing data for projected volume kube-api-access-5p9pf for pod openshift-network-diagnostics/network-check-target-trdb7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:43:31.180369 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:31.180266 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf podName:4861643d-0031-4262-ae60-9b5b94bef4a9 nodeName:}" failed. No retries permitted until 2026-07-06 20:44:03.180254448 +0000 UTC m=+67.268759464 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p9pf" (UniqueName: "kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf") pod "network-check-target-trdb7" (UID: "4861643d-0031-4262-ae60-9b5b94bef4a9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 20:43:32.420412 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:32.420376 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:32.420412 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:32.420405 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:32.420918 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:32.420492 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:32.420918 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:32.420508 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-trdb7" podUID="4861643d-0031-4262-ae60-9b5b94bef4a9" Jul 06 20:43:32.420918 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:32.420625 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ktj2" podUID="774becc8-6fe2-4ec6-aabf-a63925f4a0a6" Jul 06 20:43:32.420918 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:32.420752 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-n6q5c" podUID="e04d2210-8cbc-4669-a224-efaa7a105a01" Jul 06 20:43:33.710959 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.710885 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-228.ec2.internal" event="NodeReady" Jul 06 20:43:33.711520 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.711026 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 20:43:33.764746 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.764709 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-687fcd985d-h48tz"] Jul 06 20:43:33.782027 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.781994 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hz7nr"] Jul 06 20:43:33.782199 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.782153 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.785571 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.785547 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 20:43:33.785685 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.785664 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 20:43:33.785905 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.785888 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mzdrj\"" Jul 06 20:43:33.786160 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.786139 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 20:43:33.797506 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.797481 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 20:43:33.799961 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.799938 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vwzxl"] Jul 06 20:43:33.800107 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.800088 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hz7nr" Jul 06 20:43:33.810266 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.810244 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 20:43:33.810368 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.810292 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 20:43:33.810427 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.810391 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qchpv\"" Jul 06 20:43:33.818031 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.817999 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-687fcd985d-h48tz"] Jul 06 20:43:33.818031 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.818037 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hz7nr"] Jul 06 20:43:33.818179 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.818070 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vwzxl"] Jul 06 20:43:33.818179 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.818114 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vwzxl" Jul 06 20:43:33.821454 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.821434 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 20:43:33.821618 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.821567 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wnvmb\"" Jul 06 20:43:33.822110 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.822085 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 20:43:33.822195 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.822129 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 20:43:33.897161 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.897128 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n8gj\" (UniqueName: \"kubernetes.io/projected/fbb6eb95-ccd2-43af-90e5-b33900e750af-kube-api-access-6n8gj\") pod \"ingress-canary-vwzxl\" (UID: \"fbb6eb95-ccd2-43af-90e5-b33900e750af\") " pod="openshift-ingress-canary/ingress-canary-vwzxl" Jul 06 20:43:33.897161 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.897162 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.897345 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.897181 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72qb4\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-kube-api-access-72qb4\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.897345 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.897235 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbb6eb95-ccd2-43af-90e5-b33900e750af-cert\") pod \"ingress-canary-vwzxl\" (UID: \"fbb6eb95-ccd2-43af-90e5-b33900e750af\") " pod="openshift-ingress-canary/ingress-canary-vwzxl" Jul 06 20:43:33.897345 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.897274 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5030b055-0d90-462d-896c-b8de4f05030b-config-volume\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:43:33.897345 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.897310 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtdzm\" (UniqueName: \"kubernetes.io/projected/5030b055-0d90-462d-896c-b8de4f05030b-kube-api-access-mtdzm\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:43:33.897345 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.897331 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:43:33.897522 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.897376 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93f67bcb-0f08-4a4f-ae52-efe4d2735264-ca-trust-extracted\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.897522 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.897421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-bound-sa-token\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.897522 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.897457 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93f67bcb-0f08-4a4f-ae52-efe4d2735264-image-registry-private-configuration\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.897522 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.897478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93f67bcb-0f08-4a4f-ae52-efe4d2735264-installation-pull-secrets\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.897522 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.897518 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-certificates\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.897659 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.897540 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93f67bcb-0f08-4a4f-ae52-efe4d2735264-trusted-ca\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.897659 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.897558 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5030b055-0d90-462d-896c-b8de4f05030b-tmp-dir\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:43:33.998523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.998446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5030b055-0d90-462d-896c-b8de4f05030b-config-volume\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:43:33.998523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.998494 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtdzm\" (UniqueName: \"kubernetes.io/projected/5030b055-0d90-462d-896c-b8de4f05030b-kube-api-access-mtdzm\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:43:33.998666 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.998607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:43:33.998666 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.998644 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93f67bcb-0f08-4a4f-ae52-efe4d2735264-ca-trust-extracted\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.998741 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.998687 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-bound-sa-token\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.998741 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:33.998733 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:43:33.998814 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.998740 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93f67bcb-0f08-4a4f-ae52-efe4d2735264-image-registry-private-configuration\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.998814 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.998769 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93f67bcb-0f08-4a4f-ae52-efe4d2735264-installation-pull-secrets\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.998814 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:33.998804 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls podName:5030b055-0d90-462d-896c-b8de4f05030b nodeName:}" failed. No retries permitted until 2026-07-06 20:43:34.498782109 +0000 UTC m=+38.587287133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls") pod "dns-default-hz7nr" (UID: "5030b055-0d90-462d-896c-b8de4f05030b") : secret "dns-default-metrics-tls" not found Jul 06 20:43:33.998942 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.998836 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-certificates\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.998942 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.998864 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93f67bcb-0f08-4a4f-ae52-efe4d2735264-trusted-ca\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.998942 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.998888 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5030b055-0d90-462d-896c-b8de4f05030b-tmp-dir\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:43:33.998942 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.998915 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n8gj\" (UniqueName: \"kubernetes.io/projected/fbb6eb95-ccd2-43af-90e5-b33900e750af-kube-api-access-6n8gj\") pod \"ingress-canary-vwzxl\" (UID: \"fbb6eb95-ccd2-43af-90e5-b33900e750af\") " pod="openshift-ingress-canary/ingress-canary-vwzxl" Jul 06 20:43:33.998942 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.998940 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.999179 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.998962 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72qb4\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-kube-api-access-72qb4\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.999179 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.998991 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbb6eb95-ccd2-43af-90e5-b33900e750af-cert\") pod \"ingress-canary-vwzxl\" (UID: \"fbb6eb95-ccd2-43af-90e5-b33900e750af\") " pod="openshift-ingress-canary/ingress-canary-vwzxl" Jul 06 20:43:33.999179 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.999035 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93f67bcb-0f08-4a4f-ae52-efe4d2735264-ca-trust-extracted\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:33.999179 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:33.999143 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:43:33.999179 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:33.999156 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687fcd985d-h48tz: secret "image-registry-tls" not found Jul 06 20:43:33.999396 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:33.999196 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls podName:93f67bcb-0f08-4a4f-ae52-efe4d2735264 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:34.499182161 +0000 UTC m=+38.587687177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls") pod "image-registry-687fcd985d-h48tz" (UID: "93f67bcb-0f08-4a4f-ae52-efe4d2735264") : secret "image-registry-tls" not found Jul 06 20:43:33.999396 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.999247 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5030b055-0d90-462d-896c-b8de4f05030b-tmp-dir\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:43:33.999396 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.999140 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5030b055-0d90-462d-896c-b8de4f05030b-config-volume\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:43:33.999639 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:33.999617 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-certificates\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:34.000111 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.000083 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93f67bcb-0f08-4a4f-ae52-efe4d2735264-trusted-ca\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:34.002954 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.002925 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93f67bcb-0f08-4a4f-ae52-efe4d2735264-image-registry-private-configuration\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:34.003061 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.002971 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93f67bcb-0f08-4a4f-ae52-efe4d2735264-installation-pull-secrets\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:34.003061 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.003014 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbb6eb95-ccd2-43af-90e5-b33900e750af-cert\") pod \"ingress-canary-vwzxl\" (UID: \"fbb6eb95-ccd2-43af-90e5-b33900e750af\") " pod="openshift-ingress-canary/ingress-canary-vwzxl" Jul 06 20:43:34.015713 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.015686 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-bound-sa-token\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:34.015803 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.015748 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72qb4\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-kube-api-access-72qb4\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:34.015985 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.015964 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtdzm\" (UniqueName: \"kubernetes.io/projected/5030b055-0d90-462d-896c-b8de4f05030b-kube-api-access-mtdzm\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:43:34.016108 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.016095 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n8gj\" (UniqueName: \"kubernetes.io/projected/fbb6eb95-ccd2-43af-90e5-b33900e750af-kube-api-access-6n8gj\") pod \"ingress-canary-vwzxl\" (UID: \"fbb6eb95-ccd2-43af-90e5-b33900e750af\") " pod="openshift-ingress-canary/ingress-canary-vwzxl" Jul 06 20:43:34.128604 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.128569 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vwzxl" Jul 06 20:43:34.328290 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.328256 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vwzxl"] Jul 06 20:43:34.334388 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:43:34.334221 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb6eb95_ccd2_43af_90e5_b33900e750af.slice/crio-7df9ea16fdd7403e59d045ca17dc869db02b3115a6f9939d5268e551302774c5 WatchSource:0}: Error finding container 7df9ea16fdd7403e59d045ca17dc869db02b3115a6f9939d5268e551302774c5: Status 404 returned error can't find the container with id 7df9ea16fdd7403e59d045ca17dc869db02b3115a6f9939d5268e551302774c5 Jul 06 20:43:34.419835 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.419804 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:43:34.419835 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.419835 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:43:34.420101 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.419932 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:43:34.423025 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.422828 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:43:34.423025 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.422857 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:43:34.423025 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.422904 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:43:34.423025 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.422912 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqt4k\"" Jul 06 20:43:34.423025 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.422965 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:43:34.423350 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.423199 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5zklv\"" Jul 06 20:43:34.502623 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.502590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:34.502800 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.502674 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:43:34.502920 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:34.502895 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:43:34.503037 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:34.502998 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls podName:5030b055-0d90-462d-896c-b8de4f05030b nodeName:}" failed. No retries permitted until 2026-07-06 20:43:35.502944891 +0000 UTC m=+39.591449908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls") pod "dns-default-hz7nr" (UID: "5030b055-0d90-462d-896c-b8de4f05030b") : secret "dns-default-metrics-tls" not found Jul 06 20:43:34.503205 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:34.503172 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:43:34.503205 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:34.503199 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687fcd985d-h48tz: secret "image-registry-tls" not found Jul 06 20:43:34.503360 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:34.503275 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls podName:93f67bcb-0f08-4a4f-ae52-efe4d2735264 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:35.503253553 +0000 UTC m=+39.591758592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls") pod "image-registry-687fcd985d-h48tz" (UID: "93f67bcb-0f08-4a4f-ae52-efe4d2735264") : secret "image-registry-tls" not found Jul 06 20:43:34.598729 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:34.598651 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vwzxl" event={"ID":"fbb6eb95-ccd2-43af-90e5-b33900e750af","Type":"ContainerStarted","Data":"7df9ea16fdd7403e59d045ca17dc869db02b3115a6f9939d5268e551302774c5"} Jul 06 20:43:35.512350 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:35.512307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:35.512981 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:35.512384 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:43:35.512981 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:35.512507 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:43:35.512981 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:35.512534 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687fcd985d-h48tz: secret "image-registry-tls" not found Jul 06 20:43:35.512981 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:35.512534 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:43:35.512981 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:35.512593 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls podName:5030b055-0d90-462d-896c-b8de4f05030b nodeName:}" failed. No retries permitted until 2026-07-06 20:43:37.512578879 +0000 UTC m=+41.601083895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls") pod "dns-default-hz7nr" (UID: "5030b055-0d90-462d-896c-b8de4f05030b") : secret "dns-default-metrics-tls" not found Jul 06 20:43:35.512981 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:35.512607 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls podName:93f67bcb-0f08-4a4f-ae52-efe4d2735264 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:37.512601752 +0000 UTC m=+41.601106768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls") pod "image-registry-687fcd985d-h48tz" (UID: "93f67bcb-0f08-4a4f-ae52-efe4d2735264") : secret "image-registry-tls" not found Jul 06 20:43:37.528239 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:37.528199 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:37.528684 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:37.528254 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:43:37.528684 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:37.528367 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:43:37.528684 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:37.528384 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:43:37.528684 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:37.528409 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687fcd985d-h48tz: secret "image-registry-tls" not found Jul 06 20:43:37.528684 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:37.528418 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls podName:5030b055-0d90-462d-896c-b8de4f05030b nodeName:}" failed. No retries permitted until 2026-07-06 20:43:41.528405585 +0000 UTC m=+45.616910601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls") pod "dns-default-hz7nr" (UID: "5030b055-0d90-462d-896c-b8de4f05030b") : secret "dns-default-metrics-tls" not found Jul 06 20:43:37.528684 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:37.528463 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls podName:93f67bcb-0f08-4a4f-ae52-efe4d2735264 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:41.528446461 +0000 UTC m=+45.616951476 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls") pod "image-registry-687fcd985d-h48tz" (UID: "93f67bcb-0f08-4a4f-ae52-efe4d2735264") : secret "image-registry-tls" not found Jul 06 20:43:37.610500 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:37.610454 2579 generic.go:356] "Generic (PLEG): container finished" podID="811731cd-7f4e-4167-bc87-26a30d2c5ab3" containerID="072b72e46d2d08ffb39bb1e6ddd649cbc9f90049b35e7feee2a4183301a49650" exitCode=0 Jul 06 20:43:37.610674 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:37.610532 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qlv6j" event={"ID":"811731cd-7f4e-4167-bc87-26a30d2c5ab3","Type":"ContainerDied","Data":"072b72e46d2d08ffb39bb1e6ddd649cbc9f90049b35e7feee2a4183301a49650"} Jul 06 20:43:38.617022 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:38.616938 2579 generic.go:356] "Generic (PLEG): container finished" podID="811731cd-7f4e-4167-bc87-26a30d2c5ab3" containerID="30f77fc5c2d5566d0f4655c2229843444db1f552e31576e5200aa2a0e4f30d00" exitCode=0 Jul 06 20:43:38.617453 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:38.617012 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qlv6j" event={"ID":"811731cd-7f4e-4167-bc87-26a30d2c5ab3","Type":"ContainerDied","Data":"30f77fc5c2d5566d0f4655c2229843444db1f552e31576e5200aa2a0e4f30d00"} Jul 06 20:43:39.622813 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:39.622718 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qlv6j" event={"ID":"811731cd-7f4e-4167-bc87-26a30d2c5ab3","Type":"ContainerStarted","Data":"2422fbf9bebe724d82619e9d9ad00e16dcbee848ff7a257ff569681783c16316"} Jul 06 20:43:39.624124 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:39.624101 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vwzxl" event={"ID":"fbb6eb95-ccd2-43af-90e5-b33900e750af","Type":"ContainerStarted","Data":"f24179b0d79b1d024ec0430a0b3ffd8cf3a71bbccdf683bc86e892d8cfd76760"} Jul 06 20:43:39.652938 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:39.652887 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qlv6j" podStartSLOduration=11.448821473 podStartE2EDuration="41.652872095s" totalImagesPullingTime="30.204050622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:42:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:39.650893063 +0000 UTC m=+43.739398100" watchObservedRunningTime="2026-07-06 20:43:39.652872095 +0000 UTC m=+43.741377133" Jul 06 20:43:39.674653 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:39.674598 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vwzxl" podStartSLOduration=1.716352909 podStartE2EDuration="6.674580876s" totalImagesPullingTime="4.958227967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:43:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:43:39.674184873 +0000 UTC m=+43.762689922" watchObservedRunningTime="2026-07-06 20:43:39.674580876 +0000 UTC m=+43.763085913" Jul 06 20:43:41.556465 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:41.556259 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:43:41.556929 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:41.556422 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:43:41.556929 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:41.556540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:41.556929 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:41.556577 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls podName:5030b055-0d90-462d-896c-b8de4f05030b nodeName:}" failed. No retries permitted until 2026-07-06 20:43:49.556561837 +0000 UTC m=+53.645066852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls") pod "dns-default-hz7nr" (UID: "5030b055-0d90-462d-896c-b8de4f05030b") : secret "dns-default-metrics-tls" not found Jul 06 20:43:41.556929 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:41.556650 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:43:41.556929 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:41.556666 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687fcd985d-h48tz: secret "image-registry-tls" not found Jul 06 20:43:41.556929 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:41.556734 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls podName:93f67bcb-0f08-4a4f-ae52-efe4d2735264 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:49.556717193 +0000 UTC m=+53.645222213 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls") pod "image-registry-687fcd985d-h48tz" (UID: "93f67bcb-0f08-4a4f-ae52-efe4d2735264") : secret "image-registry-tls" not found Jul 06 20:43:49.617939 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:49.617898 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:43:49.618512 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:49.617955 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:43:49.618512 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:49.618066 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:43:49.618512 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:49.618086 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687fcd985d-h48tz: secret "image-registry-tls" not found Jul 06 20:43:49.618512 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:49.618091 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:43:49.618512 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:49.618143 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls podName:93f67bcb-0f08-4a4f-ae52-efe4d2735264 nodeName:}" failed. No retries permitted until 2026-07-06 20:44:05.618127342 +0000 UTC m=+69.706632358 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls") pod "image-registry-687fcd985d-h48tz" (UID: "93f67bcb-0f08-4a4f-ae52-efe4d2735264") : secret "image-registry-tls" not found Jul 06 20:43:49.618512 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:49.618156 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls podName:5030b055-0d90-462d-896c-b8de4f05030b nodeName:}" failed. No retries permitted until 2026-07-06 20:44:05.61815058 +0000 UTC m=+69.706655595 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls") pod "dns-default-hz7nr" (UID: "5030b055-0d90-462d-896c-b8de4f05030b") : secret "dns-default-metrics-tls" not found Jul 06 20:43:57.760363 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.760312 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf"] Jul 06 20:43:57.793240 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.793208 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5"] Jul 06 20:43:57.793397 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.793320 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf" Jul 06 20:43:57.795919 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.795892 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jwbkh\"" Jul 06 20:43:57.796757 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.796741 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 20:43:57.796843 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.796743 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 20:43:57.796843 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.796744 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:43:57.812939 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.812920 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf"] Jul 06 20:43:57.813038 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.812950 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5"] Jul 06 20:43:57.813038 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.813019 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5" Jul 06 20:43:57.815679 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.815660 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dcrjr\"" Jul 06 20:43:57.816061 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.816029 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 20:43:57.816138 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.816064 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 20:43:57.816280 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.816268 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 20:43:57.816432 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.816420 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 20:43:57.867411 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.867368 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz"] Jul 06 20:43:57.876917 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.876890 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8p5f\" (UniqueName: \"kubernetes.io/projected/fba31ca8-9ebf-4356-bf12-c6478544ca0d-kube-api-access-w8p5f\") pod \"service-ca-operator-5d46d9ffd4-r77q5\" (UID: \"fba31ca8-9ebf-4356-bf12-c6478544ca0d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5" Jul 06 20:43:57.877060 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.876952 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fba31ca8-9ebf-4356-bf12-c6478544ca0d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-r77q5\" (UID: \"fba31ca8-9ebf-4356-bf12-c6478544ca0d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5" Jul 06 20:43:57.877060 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.876973 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fba31ca8-9ebf-4356-bf12-c6478544ca0d-config\") pod \"service-ca-operator-5d46d9ffd4-r77q5\" (UID: \"fba31ca8-9ebf-4356-bf12-c6478544ca0d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5" Jul 06 20:43:57.877060 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.876998 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ppppf\" (UID: \"5a0a05de-e40d-4933-a589-4eda54f29f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf" Jul 06 20:43:57.877060 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.877019 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c95nk\" (UniqueName: \"kubernetes.io/projected/5a0a05de-e40d-4933-a589-4eda54f29f3b-kube-api-access-c95nk\") pod \"cluster-samples-operator-56fcf86bf-ppppf\" (UID: \"5a0a05de-e40d-4933-a589-4eda54f29f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf" Jul 06 20:43:57.889207 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.889187 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" Jul 06 20:43:57.896789 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.896770 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 20:43:57.896789 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.896784 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 20:43:57.898146 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.898128 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 20:43:57.898197 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.898150 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 20:43:57.898228 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.898133 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zpglw\"" Jul 06 20:43:57.933242 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.933215 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz"] Jul 06 20:43:57.977292 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.977261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fba31ca8-9ebf-4356-bf12-c6478544ca0d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-r77q5\" (UID: \"fba31ca8-9ebf-4356-bf12-c6478544ca0d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5" Jul 06 20:43:57.977292 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.977297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fba31ca8-9ebf-4356-bf12-c6478544ca0d-config\") pod \"service-ca-operator-5d46d9ffd4-r77q5\" (UID: \"fba31ca8-9ebf-4356-bf12-c6478544ca0d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5" Jul 06 20:43:57.977530 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.977325 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ppppf\" (UID: \"5a0a05de-e40d-4933-a589-4eda54f29f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf" Jul 06 20:43:57.977530 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.977344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c95nk\" (UniqueName: \"kubernetes.io/projected/5a0a05de-e40d-4933-a589-4eda54f29f3b-kube-api-access-c95nk\") pod \"cluster-samples-operator-56fcf86bf-ppppf\" (UID: \"5a0a05de-e40d-4933-a589-4eda54f29f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf" Jul 06 20:43:57.977530 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.977369 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9r5rz\" (UID: \"14b6e54d-55ec-4e9b-8363-cbb12e017b88\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" Jul 06 20:43:57.977530 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.977408 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjfg8\" (UniqueName: \"kubernetes.io/projected/14b6e54d-55ec-4e9b-8363-cbb12e017b88-kube-api-access-mjfg8\") pod \"cluster-monitoring-operator-64786d9cbb-9r5rz\" (UID: \"14b6e54d-55ec-4e9b-8363-cbb12e017b88\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" Jul 06 20:43:57.977530 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:57.977430 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 20:43:57.977530 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.977469 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/14b6e54d-55ec-4e9b-8363-cbb12e017b88-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-9r5rz\" (UID: \"14b6e54d-55ec-4e9b-8363-cbb12e017b88\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" Jul 06 20:43:57.977530 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:57.977513 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls podName:5a0a05de-e40d-4933-a589-4eda54f29f3b nodeName:}" failed. No retries permitted until 2026-07-06 20:43:58.477489398 +0000 UTC m=+62.565994418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ppppf" (UID: "5a0a05de-e40d-4933-a589-4eda54f29f3b") : secret "samples-operator-tls" not found Jul 06 20:43:57.977869 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.977558 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8p5f\" (UniqueName: \"kubernetes.io/projected/fba31ca8-9ebf-4356-bf12-c6478544ca0d-kube-api-access-w8p5f\") pod \"service-ca-operator-5d46d9ffd4-r77q5\" (UID: \"fba31ca8-9ebf-4356-bf12-c6478544ca0d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5" Jul 06 20:43:57.978032 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.978011 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fba31ca8-9ebf-4356-bf12-c6478544ca0d-config\") pod \"service-ca-operator-5d46d9ffd4-r77q5\" (UID: \"fba31ca8-9ebf-4356-bf12-c6478544ca0d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5" Jul 06 20:43:57.981181 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.981166 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fba31ca8-9ebf-4356-bf12-c6478544ca0d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-r77q5\" (UID: \"fba31ca8-9ebf-4356-bf12-c6478544ca0d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5" Jul 06 20:43:57.995807 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:57.995779 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c95nk\" (UniqueName: \"kubernetes.io/projected/5a0a05de-e40d-4933-a589-4eda54f29f3b-kube-api-access-c95nk\") pod \"cluster-samples-operator-56fcf86bf-ppppf\" (UID: \"5a0a05de-e40d-4933-a589-4eda54f29f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf" Jul 06 20:43:58.002331 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:58.002307 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8p5f\" (UniqueName: \"kubernetes.io/projected/fba31ca8-9ebf-4356-bf12-c6478544ca0d-kube-api-access-w8p5f\") pod \"service-ca-operator-5d46d9ffd4-r77q5\" (UID: \"fba31ca8-9ebf-4356-bf12-c6478544ca0d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5" Jul 06 20:43:58.078670 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:58.078578 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9r5rz\" (UID: \"14b6e54d-55ec-4e9b-8363-cbb12e017b88\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" Jul 06 20:43:58.078670 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:58.078631 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjfg8\" (UniqueName: \"kubernetes.io/projected/14b6e54d-55ec-4e9b-8363-cbb12e017b88-kube-api-access-mjfg8\") pod \"cluster-monitoring-operator-64786d9cbb-9r5rz\" (UID: \"14b6e54d-55ec-4e9b-8363-cbb12e017b88\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" Jul 06 20:43:58.078670 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:58.078672 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/14b6e54d-55ec-4e9b-8363-cbb12e017b88-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-9r5rz\" (UID: \"14b6e54d-55ec-4e9b-8363-cbb12e017b88\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" Jul 06 20:43:58.078956 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:58.078735 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:43:58.078956 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:58.078808 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls podName:14b6e54d-55ec-4e9b-8363-cbb12e017b88 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:58.578792423 +0000 UTC m=+62.667297439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-9r5rz" (UID: "14b6e54d-55ec-4e9b-8363-cbb12e017b88") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:43:58.079348 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:58.079331 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/14b6e54d-55ec-4e9b-8363-cbb12e017b88-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-9r5rz\" (UID: \"14b6e54d-55ec-4e9b-8363-cbb12e017b88\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" Jul 06 20:43:58.094366 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:58.094343 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjfg8\" (UniqueName: \"kubernetes.io/projected/14b6e54d-55ec-4e9b-8363-cbb12e017b88-kube-api-access-mjfg8\") pod \"cluster-monitoring-operator-64786d9cbb-9r5rz\" (UID: \"14b6e54d-55ec-4e9b-8363-cbb12e017b88\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" Jul 06 20:43:58.121579 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:58.121544 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5" Jul 06 20:43:58.297522 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:58.297491 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5"] Jul 06 20:43:58.300576 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:43:58.300546 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfba31ca8_9ebf_4356_bf12_c6478544ca0d.slice/crio-bfbbeeab2d5a4451a27f1f38ed40e0f04b1190635c7ca5e7f118c1cf3164fbd4 WatchSource:0}: Error finding container bfbbeeab2d5a4451a27f1f38ed40e0f04b1190635c7ca5e7f118c1cf3164fbd4: Status 404 returned error can't find the container with id bfbbeeab2d5a4451a27f1f38ed40e0f04b1190635c7ca5e7f118c1cf3164fbd4 Jul 06 20:43:58.481567 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:58.481523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ppppf\" (UID: \"5a0a05de-e40d-4933-a589-4eda54f29f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf" Jul 06 20:43:58.481752 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:58.481666 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 20:43:58.481752 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:58.481735 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls podName:5a0a05de-e40d-4933-a589-4eda54f29f3b nodeName:}" failed. No retries permitted until 2026-07-06 20:43:59.481720414 +0000 UTC m=+63.570225430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ppppf" (UID: "5a0a05de-e40d-4933-a589-4eda54f29f3b") : secret "samples-operator-tls" not found Jul 06 20:43:58.582132 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:58.582102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9r5rz\" (UID: \"14b6e54d-55ec-4e9b-8363-cbb12e017b88\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" Jul 06 20:43:58.582286 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:58.582208 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:43:58.582286 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:58.582263 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls podName:14b6e54d-55ec-4e9b-8363-cbb12e017b88 nodeName:}" failed. No retries permitted until 2026-07-06 20:43:59.582249288 +0000 UTC m=+63.670754308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-9r5rz" (UID: "14b6e54d-55ec-4e9b-8363-cbb12e017b88") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:43:58.589066 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:58.589029 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ltvbf" Jul 06 20:43:58.670910 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:58.670872 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5" event={"ID":"fba31ca8-9ebf-4356-bf12-c6478544ca0d","Type":"ContainerStarted","Data":"bfbbeeab2d5a4451a27f1f38ed40e0f04b1190635c7ca5e7f118c1cf3164fbd4"} Jul 06 20:43:59.490852 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:59.490813 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ppppf\" (UID: \"5a0a05de-e40d-4933-a589-4eda54f29f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf" Jul 06 20:43:59.491291 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:59.490986 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 20:43:59.491291 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:59.491100 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls podName:5a0a05de-e40d-4933-a589-4eda54f29f3b nodeName:}" failed. No retries permitted until 2026-07-06 20:44:01.491075815 +0000 UTC m=+65.579580831 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ppppf" (UID: "5a0a05de-e40d-4933-a589-4eda54f29f3b") : secret "samples-operator-tls" not found Jul 06 20:43:59.591426 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:43:59.591395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9r5rz\" (UID: \"14b6e54d-55ec-4e9b-8363-cbb12e017b88\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" Jul 06 20:43:59.591608 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:59.591498 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:43:59.591608 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:43:59.591553 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls podName:14b6e54d-55ec-4e9b-8363-cbb12e017b88 nodeName:}" failed. No retries permitted until 2026-07-06 20:44:01.591538154 +0000 UTC m=+65.680043169 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-9r5rz" (UID: "14b6e54d-55ec-4e9b-8363-cbb12e017b88") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:44:00.677545 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:00.677505 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5" event={"ID":"fba31ca8-9ebf-4356-bf12-c6478544ca0d","Type":"ContainerStarted","Data":"6cd317d08ccb188bb39e2a8dc3ca48c79ac2e4d8e5d4c132a0cbfdc85066963f"} Jul 06 20:44:00.700928 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:00.700849 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5" podStartSLOduration=1.448873211 podStartE2EDuration="3.700833151s" totalImagesPullingTime="2.25195994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:43:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:00.700168261 +0000 UTC m=+64.788673309" watchObservedRunningTime="2026-07-06 20:44:00.700833151 +0000 UTC m=+64.789338188" Jul 06 20:44:01.088458 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:01.088419 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb"] Jul 06 20:44:01.090185 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:01.090165 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb" Jul 06 20:44:01.092839 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:01.092817 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 20:44:01.093118 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:01.093101 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 20:44:01.093280 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:01.093264 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lx2qw\"" Jul 06 20:44:01.102365 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:01.102343 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19335140-b661-4ef4-a9bc-fd0614754e3e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-fzfzb\" (UID: \"19335140-b661-4ef4-a9bc-fd0614754e3e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb" Jul 06 20:44:01.102448 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:01.102382 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fzfzb\" (UID: \"19335140-b661-4ef4-a9bc-fd0614754e3e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb" Jul 06 20:44:01.107061 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:01.107028 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb"] Jul 06 20:44:01.203586 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:01.203526 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19335140-b661-4ef4-a9bc-fd0614754e3e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-fzfzb\" (UID: \"19335140-b661-4ef4-a9bc-fd0614754e3e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb" Jul 06 20:44:01.203766 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:01.203611 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fzfzb\" (UID: \"19335140-b661-4ef4-a9bc-fd0614754e3e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb" Jul 06 20:44:01.203766 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:01.203741 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 20:44:01.203846 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:01.203835 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert podName:19335140-b661-4ef4-a9bc-fd0614754e3e nodeName:}" failed. No retries permitted until 2026-07-06 20:44:01.703818144 +0000 UTC m=+65.792323164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fzfzb" (UID: "19335140-b661-4ef4-a9bc-fd0614754e3e") : secret "networking-console-plugin-cert" not found Jul 06 20:44:01.204272 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:01.204248 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19335140-b661-4ef4-a9bc-fd0614754e3e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-fzfzb\" (UID: \"19335140-b661-4ef4-a9bc-fd0614754e3e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb" Jul 06 20:44:01.505359 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:01.505242 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ppppf\" (UID: \"5a0a05de-e40d-4933-a589-4eda54f29f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf" Jul 06 20:44:01.505575 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:01.505390 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 20:44:01.505575 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:01.505457 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls podName:5a0a05de-e40d-4933-a589-4eda54f29f3b nodeName:}" failed. No retries permitted until 2026-07-06 20:44:05.505441902 +0000 UTC m=+69.593946917 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ppppf" (UID: "5a0a05de-e40d-4933-a589-4eda54f29f3b") : secret "samples-operator-tls" not found Jul 06 20:44:01.606383 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:01.606348 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9r5rz\" (UID: \"14b6e54d-55ec-4e9b-8363-cbb12e017b88\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" Jul 06 20:44:01.606536 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:01.606497 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:44:01.606578 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:01.606563 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls podName:14b6e54d-55ec-4e9b-8363-cbb12e017b88 nodeName:}" failed. No retries permitted until 2026-07-06 20:44:05.606548359 +0000 UTC m=+69.695053375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-9r5rz" (UID: "14b6e54d-55ec-4e9b-8363-cbb12e017b88") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:44:01.707143 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:01.707100 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fzfzb\" (UID: \"19335140-b661-4ef4-a9bc-fd0614754e3e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb" Jul 06 20:44:01.707529 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:01.707181 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 20:44:01.707529 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:01.707263 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert podName:19335140-b661-4ef4-a9bc-fd0614754e3e nodeName:}" failed. No retries permitted until 2026-07-06 20:44:02.707242001 +0000 UTC m=+66.795747017 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fzfzb" (UID: "19335140-b661-4ef4-a9bc-fd0614754e3e") : secret "networking-console-plugin-cert" not found Jul 06 20:44:02.714534 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:02.714490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fzfzb\" (UID: \"19335140-b661-4ef4-a9bc-fd0614754e3e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb" Jul 06 20:44:02.714921 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:02.714620 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 20:44:02.714921 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:02.714674 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert podName:19335140-b661-4ef4-a9bc-fd0614754e3e nodeName:}" failed. No retries permitted until 2026-07-06 20:44:04.71465993 +0000 UTC m=+68.803164946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fzfzb" (UID: "19335140-b661-4ef4-a9bc-fd0614754e3e") : secret "networking-console-plugin-cert" not found Jul 06 20:44:03.118401 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:03.118358 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs\") pod \"network-metrics-daemon-4ktj2\" (UID: \"774becc8-6fe2-4ec6-aabf-a63925f4a0a6\") " pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:44:03.118551 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:03.118503 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret\") pod \"global-pull-secret-syncer-n6q5c\" (UID: \"e04d2210-8cbc-4669-a224-efaa7a105a01\") " pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:44:03.165229 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:03.165198 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 20:44:03.165507 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:03.165490 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 20:44:03.169408 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:03.169381 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 20:44:03.169481 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:03.169458 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs podName:774becc8-6fe2-4ec6-aabf-a63925f4a0a6 nodeName:}" failed. No retries permitted until 2026-07-06 20:45:07.169441791 +0000 UTC m=+131.257946810 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs") pod "network-metrics-daemon-4ktj2" (UID: "774becc8-6fe2-4ec6-aabf-a63925f4a0a6") : secret "metrics-daemon-secret" not found Jul 06 20:44:03.171647 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:03.171620 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e04d2210-8cbc-4669-a224-efaa7a105a01-original-pull-secret\") pod \"global-pull-secret-syncer-n6q5c\" (UID: \"e04d2210-8cbc-4669-a224-efaa7a105a01\") " pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:44:03.219518 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:03.219468 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p9pf\" (UniqueName: \"kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf\") pod \"network-check-target-trdb7\" (UID: \"4861643d-0031-4262-ae60-9b5b94bef4a9\") " pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:44:03.222587 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:03.222563 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 20:44:03.235201 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:03.235168 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 20:44:03.242825 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:03.242792 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-n6q5c" Jul 06 20:44:03.243222 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:03.243200 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p9pf\" (UniqueName: \"kubernetes.io/projected/4861643d-0031-4262-ae60-9b5b94bef4a9-kube-api-access-5p9pf\") pod \"network-check-target-trdb7\" (UID: \"4861643d-0031-4262-ae60-9b5b94bef4a9\") " pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:44:03.382536 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:03.382432 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-n6q5c"] Jul 06 20:44:03.386533 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:44:03.386502 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04d2210_8cbc_4669_a224_efaa7a105a01.slice/crio-dc9ab1670f7981e4fd97f79ac07fc0302590ba6f0e13423e2f26b3cf839fbdee WatchSource:0}: Error finding container dc9ab1670f7981e4fd97f79ac07fc0302590ba6f0e13423e2f26b3cf839fbdee: Status 404 returned error can't find the container with id dc9ab1670f7981e4fd97f79ac07fc0302590ba6f0e13423e2f26b3cf839fbdee Jul 06 20:44:03.541332 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:03.541297 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5zklv\"" Jul 06 20:44:03.549059 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:03.549027 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:44:03.685362 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:03.685270 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n6q5c" event={"ID":"e04d2210-8cbc-4669-a224-efaa7a105a01","Type":"ContainerStarted","Data":"dc9ab1670f7981e4fd97f79ac07fc0302590ba6f0e13423e2f26b3cf839fbdee"} Jul 06 20:44:03.691234 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:03.691206 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-trdb7"] Jul 06 20:44:03.694877 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:44:03.694854 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4861643d_0031_4262_ae60_9b5b94bef4a9.slice/crio-b8808b1c884229d15002ad7f8f30e53441df09fd474c98441c08f0d9053939fd WatchSource:0}: Error finding container b8808b1c884229d15002ad7f8f30e53441df09fd474c98441c08f0d9053939fd: Status 404 returned error can't find the container with id b8808b1c884229d15002ad7f8f30e53441df09fd474c98441c08f0d9053939fd Jul 06 20:44:04.197305 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.197274 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8s8rq"] Jul 06 20:44:04.201021 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.201000 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:04.204494 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.204473 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 20:44:04.204605 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.204497 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 20:44:04.204605 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.204478 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 20:44:04.204913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.204894 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sl5zj\"" Jul 06 20:44:04.204986 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.204967 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 20:44:04.226501 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.226476 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8s8rq"] Jul 06 20:44:04.228633 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.228544 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-crio-socket\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:04.228773 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.228715 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:04.228839 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.228782 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-data-volume\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:04.228900 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.228853 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pv9t\" (UniqueName: \"kubernetes.io/projected/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-api-access-2pv9t\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:04.228900 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.228880 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:04.329687 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.329640 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:04.329874 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.329704 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-crio-socket\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:04.329874 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.329793 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-crio-socket\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:04.329874 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:04.329841 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:44:04.330039 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:04.329915 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls podName:853c3eb3-b77b-493c-80e1-3bcddf56ee0f nodeName:}" failed. No retries permitted until 2026-07-06 20:44:04.829894089 +0000 UTC m=+68.918399124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8s8rq" (UID: "853c3eb3-b77b-493c-80e1-3bcddf56ee0f") : secret "insights-runtime-extractor-tls" not found Jul 06 20:44:04.330039 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.330028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:04.330191 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.330091 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-data-volume\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:04.330191 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:04.330118 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:44:04.330191 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.330158 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pv9t\" (UniqueName: \"kubernetes.io/projected/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-api-access-2pv9t\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:04.330191 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:04.330184 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm podName:853c3eb3-b77b-493c-80e1-3bcddf56ee0f nodeName:}" failed. No retries permitted until 2026-07-06 20:44:04.830164896 +0000 UTC m=+68.918669915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8s8rq" (UID: "853c3eb3-b77b-493c-80e1-3bcddf56ee0f") : configmap "kube-rbac-proxy" not found Jul 06 20:44:04.330523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.330486 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-data-volume\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:04.351387 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.351315 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pv9t\" (UniqueName: \"kubernetes.io/projected/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-api-access-2pv9t\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:04.689663 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.689610 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-trdb7" event={"ID":"4861643d-0031-4262-ae60-9b5b94bef4a9","Type":"ContainerStarted","Data":"b8808b1c884229d15002ad7f8f30e53441df09fd474c98441c08f0d9053939fd"} Jul 06 20:44:04.733940 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.733897 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fzfzb\" (UID: \"19335140-b661-4ef4-a9bc-fd0614754e3e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb" Jul 06 20:44:04.734139 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:04.734074 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 20:44:04.734206 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:04.734151 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert podName:19335140-b661-4ef4-a9bc-fd0614754e3e nodeName:}" failed. No retries permitted until 2026-07-06 20:44:08.734133545 +0000 UTC m=+72.822638566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fzfzb" (UID: "19335140-b661-4ef4-a9bc-fd0614754e3e") : secret "networking-console-plugin-cert" not found Jul 06 20:44:04.834408 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.834361 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:04.834595 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:04.834500 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:04.834595 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:04.834535 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:44:04.834699 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:04.834612 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls podName:853c3eb3-b77b-493c-80e1-3bcddf56ee0f nodeName:}" failed. No retries permitted until 2026-07-06 20:44:05.834592115 +0000 UTC m=+69.923097155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8s8rq" (UID: "853c3eb3-b77b-493c-80e1-3bcddf56ee0f") : secret "insights-runtime-extractor-tls" not found Jul 06 20:44:04.834699 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:04.834671 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:44:04.834828 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:04.834807 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm podName:853c3eb3-b77b-493c-80e1-3bcddf56ee0f nodeName:}" failed. No retries permitted until 2026-07-06 20:44:05.83478671 +0000 UTC m=+69.923291737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8s8rq" (UID: "853c3eb3-b77b-493c-80e1-3bcddf56ee0f") : configmap "kube-rbac-proxy" not found Jul 06 20:44:05.541005 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:05.540963 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ppppf\" (UID: \"5a0a05de-e40d-4933-a589-4eda54f29f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf" Jul 06 20:44:05.541513 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:05.541147 2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 20:44:05.541513 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:05.541215 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls podName:5a0a05de-e40d-4933-a589-4eda54f29f3b nodeName:}" failed. No retries permitted until 2026-07-06 20:44:13.541199025 +0000 UTC m=+77.629704041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-ppppf" (UID: "5a0a05de-e40d-4933-a589-4eda54f29f3b") : secret "samples-operator-tls" not found Jul 06 20:44:05.642062 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:05.642007 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:44:05.642251 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:05.642181 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:44:05.642251 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:05.642231 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9r5rz\" (UID: \"14b6e54d-55ec-4e9b-8363-cbb12e017b88\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" Jul 06 20:44:05.642365 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:05.642182 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 20:44:05.642365 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:05.642281 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-687fcd985d-h48tz: secret "image-registry-tls" not found Jul 06 20:44:05.642365 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:05.642245 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 20:44:05.642365 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:05.642351 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls podName:93f67bcb-0f08-4a4f-ae52-efe4d2735264 nodeName:}" failed. No retries permitted until 2026-07-06 20:44:37.642330488 +0000 UTC m=+101.730835523 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls") pod "image-registry-687fcd985d-h48tz" (UID: "93f67bcb-0f08-4a4f-ae52-efe4d2735264") : secret "image-registry-tls" not found Jul 06 20:44:05.642538 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:05.642373 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:44:05.642538 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:05.642382 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls podName:5030b055-0d90-462d-896c-b8de4f05030b nodeName:}" failed. No retries permitted until 2026-07-06 20:44:37.642370361 +0000 UTC m=+101.730875389 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls") pod "dns-default-hz7nr" (UID: "5030b055-0d90-462d-896c-b8de4f05030b") : secret "dns-default-metrics-tls" not found Jul 06 20:44:05.642538 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:05.642452 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls podName:14b6e54d-55ec-4e9b-8363-cbb12e017b88 nodeName:}" failed. No retries permitted until 2026-07-06 20:44:13.642433393 +0000 UTC m=+77.730938423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-9r5rz" (UID: "14b6e54d-55ec-4e9b-8363-cbb12e017b88") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:44:05.844128 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:05.844092 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:05.844323 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:05.844175 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:05.844323 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:05.844247 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:44:05.844453 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:05.844331 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm podName:853c3eb3-b77b-493c-80e1-3bcddf56ee0f nodeName:}" failed. No retries permitted until 2026-07-06 20:44:07.844310528 +0000 UTC m=+71.932815552 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8s8rq" (UID: "853c3eb3-b77b-493c-80e1-3bcddf56ee0f") : configmap "kube-rbac-proxy" not found Jul 06 20:44:05.844453 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:05.844343 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:44:05.844453 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:05.844425 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls podName:853c3eb3-b77b-493c-80e1-3bcddf56ee0f nodeName:}" failed. No retries permitted until 2026-07-06 20:44:07.844406385 +0000 UTC m=+71.932911424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8s8rq" (UID: "853c3eb3-b77b-493c-80e1-3bcddf56ee0f") : secret "insights-runtime-extractor-tls" not found Jul 06 20:44:06.006925 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:06.006899 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2n66c_e2731a50-9ac2-464f-93ff-1baaade87306/dns-node-resolver/0.log" Jul 06 20:44:06.992861 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:06.992824 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cwdkh_e33c4557-9986-481f-8088-cc0142641a11/node-ca/0.log" Jul 06 20:44:07.862700 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:07.862661 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:07.862893 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:07.862766 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:07.862893 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:07.862794 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:44:07.862893 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:07.862867 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm podName:853c3eb3-b77b-493c-80e1-3bcddf56ee0f nodeName:}" failed. No retries permitted until 2026-07-06 20:44:11.862850054 +0000 UTC m=+75.951355091 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8s8rq" (UID: "853c3eb3-b77b-493c-80e1-3bcddf56ee0f") : configmap "kube-rbac-proxy" not found Jul 06 20:44:07.863099 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:07.862918 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:44:07.863099 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:07.862985 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls podName:853c3eb3-b77b-493c-80e1-3bcddf56ee0f nodeName:}" failed. No retries permitted until 2026-07-06 20:44:11.86296376 +0000 UTC m=+75.951468791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8s8rq" (UID: "853c3eb3-b77b-493c-80e1-3bcddf56ee0f") : secret "insights-runtime-extractor-tls" not found Jul 06 20:44:08.191720 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:08.191626 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vwzxl_fbb6eb95-ccd2-43af-90e5-b33900e750af/serve-healthcheck-canary/0.log" Jul 06 20:44:08.701734 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:08.701693 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-n6q5c" event={"ID":"e04d2210-8cbc-4669-a224-efaa7a105a01","Type":"ContainerStarted","Data":"d5d72c8224f474c66bad9e94da85e5d5d0e8709a0b3fa7398b4eb22d34f10970"} Jul 06 20:44:08.703257 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:08.703227 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-trdb7" event={"ID":"4861643d-0031-4262-ae60-9b5b94bef4a9","Type":"ContainerStarted","Data":"94f69e66ba579a8b0b2f8e82355ee0cd66af05a60a61348a030c75882a451080"} Jul 06 20:44:08.703387 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:08.703362 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:44:08.743830 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:08.743730 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-n6q5c" podStartSLOduration=65.66690377 podStartE2EDuration="1m10.743716645s" totalImagesPullingTime="5.076812875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:08.742368508 +0000 UTC m=+72.830873546" watchObservedRunningTime="2026-07-06 20:44:08.743716645 +0000 UTC m=+72.832221682" Jul 06 20:44:08.769604 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:08.769564 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fzfzb\" (UID: \"19335140-b661-4ef4-a9bc-fd0614754e3e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb" Jul 06 20:44:08.769779 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:08.769688 2579 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 20:44:08.769779 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:08.769745 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert podName:19335140-b661-4ef4-a9bc-fd0614754e3e nodeName:}" failed. No retries permitted until 2026-07-06 20:44:16.769729152 +0000 UTC m=+80.858234168 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-fzfzb" (UID: "19335140-b661-4ef4-a9bc-fd0614754e3e") : secret "networking-console-plugin-cert" not found Jul 06 20:44:08.770913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:08.770872 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-trdb7" podStartSLOduration=66.005771898 podStartE2EDuration="1m10.770858311s" totalImagesPullingTime="4.765086413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:08.769593405 +0000 UTC m=+72.858098444" watchObservedRunningTime="2026-07-06 20:44:08.770858311 +0000 UTC m=+72.859363349" Jul 06 20:44:11.897487 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:11.897448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:11.897857 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:11.897536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:11.897857 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:11.897592 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 20:44:11.897857 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:11.897614 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 20:44:11.897857 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:11.897653 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls podName:853c3eb3-b77b-493c-80e1-3bcddf56ee0f nodeName:}" failed. No retries permitted until 2026-07-06 20:44:19.897639092 +0000 UTC m=+83.986144107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8s8rq" (UID: "853c3eb3-b77b-493c-80e1-3bcddf56ee0f") : secret "insights-runtime-extractor-tls" not found Jul 06 20:44:11.897857 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:11.897668 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm podName:853c3eb3-b77b-493c-80e1-3bcddf56ee0f nodeName:}" failed. No retries permitted until 2026-07-06 20:44:19.897661942 +0000 UTC m=+83.986166958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8s8rq" (UID: "853c3eb3-b77b-493c-80e1-3bcddf56ee0f") : configmap "kube-rbac-proxy" not found Jul 06 20:44:13.611421 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:13.611381 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ppppf\" (UID: \"5a0a05de-e40d-4933-a589-4eda54f29f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf" Jul 06 20:44:13.613729 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:13.613710 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a0a05de-e40d-4933-a589-4eda54f29f3b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-ppppf\" (UID: \"5a0a05de-e40d-4933-a589-4eda54f29f3b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf" Jul 06 20:44:13.701616 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:13.701573 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf" Jul 06 20:44:13.712281 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:13.712257 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9r5rz\" (UID: \"14b6e54d-55ec-4e9b-8363-cbb12e017b88\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" Jul 06 20:44:13.712470 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:13.712449 2579 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 20:44:13.712545 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:44:13.712532 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls podName:14b6e54d-55ec-4e9b-8363-cbb12e017b88 nodeName:}" failed. No retries permitted until 2026-07-06 20:44:29.712510984 +0000 UTC m=+93.801016000 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-9r5rz" (UID: "14b6e54d-55ec-4e9b-8363-cbb12e017b88") : secret "cluster-monitoring-operator-tls" not found Jul 06 20:44:13.848780 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:13.848749 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf"] Jul 06 20:44:14.720453 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:14.720378 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf" event={"ID":"5a0a05de-e40d-4933-a589-4eda54f29f3b","Type":"ContainerStarted","Data":"40457dc4f2737e60e7771919cf0d663d18feda938b874d117ece7922a0fecbb1"} Jul 06 20:44:16.728712 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:16.728674 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf" event={"ID":"5a0a05de-e40d-4933-a589-4eda54f29f3b","Type":"ContainerStarted","Data":"2533baab35ba9faee0086e615c538139670d173f58466756b59bdd343af8467a"} Jul 06 20:44:16.729134 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:16.728727 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf" event={"ID":"5a0a05de-e40d-4933-a589-4eda54f29f3b","Type":"ContainerStarted","Data":"811f3311036296724222036a3166f9f400c887eb74a8dbd45b36fedb9d359a3c"} Jul 06 20:44:16.765128 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:16.765081 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-ppppf" podStartSLOduration=17.785287494 podStartE2EDuration="19.765065803s" totalImagesPullingTime="1.979778309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:43:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:16.763403643 +0000 UTC m=+80.851908683" watchObservedRunningTime="2026-07-06 20:44:16.765065803 +0000 UTC m=+80.853570841" Jul 06 20:44:16.839685 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:16.839646 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fzfzb\" (UID: \"19335140-b661-4ef4-a9bc-fd0614754e3e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb" Jul 06 20:44:16.842075 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:16.842032 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/19335140-b661-4ef4-a9bc-fd0614754e3e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-fzfzb\" (UID: \"19335140-b661-4ef4-a9bc-fd0614754e3e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb" Jul 06 20:44:16.999356 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:16.999266 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb" Jul 06 20:44:17.133348 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:17.133208 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb"] Jul 06 20:44:17.135805 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:44:17.135779 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19335140_b661_4ef4_a9bc_fd0614754e3e.slice/crio-44759e986ee7281f0bccb6f6460f2519644909e21adb8e2df3d525dd5bd76ade WatchSource:0}: Error finding container 44759e986ee7281f0bccb6f6460f2519644909e21adb8e2df3d525dd5bd76ade: Status 404 returned error can't find the container with id 44759e986ee7281f0bccb6f6460f2519644909e21adb8e2df3d525dd5bd76ade Jul 06 20:44:17.733225 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:17.733184 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb" event={"ID":"19335140-b661-4ef4-a9bc-fd0614754e3e","Type":"ContainerStarted","Data":"44759e986ee7281f0bccb6f6460f2519644909e21adb8e2df3d525dd5bd76ade"} Jul 06 20:44:19.741259 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:19.741224 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb" event={"ID":"19335140-b661-4ef4-a9bc-fd0614754e3e","Type":"ContainerStarted","Data":"6654e0483311b374b68059f71673f80359b628efe5b8c25a2dc72efa7f578798"} Jul 06 20:44:19.765990 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:19.765938 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-fzfzb" podStartSLOduration=17.17606989 podStartE2EDuration="18.76592316s" totalImagesPullingTime="1.58985327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:19.765194168 +0000 UTC m=+83.853699207" watchObservedRunningTime="2026-07-06 20:44:19.76592316 +0000 UTC m=+83.854428198" Jul 06 20:44:19.965960 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:19.965922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:19.966144 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:19.965993 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:19.966499 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:19.966470 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:19.968294 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:19.968273 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/853c3eb3-b77b-493c-80e1-3bcddf56ee0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8s8rq\" (UID: \"853c3eb3-b77b-493c-80e1-3bcddf56ee0f\") " pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:20.109882 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:20.109854 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8s8rq" Jul 06 20:44:20.244940 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:20.244910 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8s8rq"] Jul 06 20:44:20.248437 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:44:20.248401 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853c3eb3_b77b_493c_80e1_3bcddf56ee0f.slice/crio-1feca6d8c3058d36c948853ff67e16cf6d4497aebcd8db2cb2ee9efcec8e13dc WatchSource:0}: Error finding container 1feca6d8c3058d36c948853ff67e16cf6d4497aebcd8db2cb2ee9efcec8e13dc: Status 404 returned error can't find the container with id 1feca6d8c3058d36c948853ff67e16cf6d4497aebcd8db2cb2ee9efcec8e13dc Jul 06 20:44:20.746552 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:20.746511 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8s8rq" event={"ID":"853c3eb3-b77b-493c-80e1-3bcddf56ee0f","Type":"ContainerStarted","Data":"1feca6d8c3058d36c948853ff67e16cf6d4497aebcd8db2cb2ee9efcec8e13dc"} Jul 06 20:44:24.763063 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:24.763010 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8s8rq" event={"ID":"853c3eb3-b77b-493c-80e1-3bcddf56ee0f","Type":"ContainerStarted","Data":"4e27f8635c4d57ce38202bdc1d9fa6e6c488134c5a5a3310cc386abea6bfc2eb"} Jul 06 20:44:24.763434 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:24.763093 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8s8rq" event={"ID":"853c3eb3-b77b-493c-80e1-3bcddf56ee0f","Type":"ContainerStarted","Data":"294049efc695cae8845a6c0d289cadf9c2e65abc5b973a90c19d80f76858806a"} Jul 06 20:44:27.774446 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:27.774404 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8s8rq" event={"ID":"853c3eb3-b77b-493c-80e1-3bcddf56ee0f","Type":"ContainerStarted","Data":"3b0684cf39a3db0a78e251ba472f744eeea053f08dbe4b0e2a8b8f3b06546cd9"} Jul 06 20:44:27.804332 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:27.804280 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8s8rq" podStartSLOduration=17.040298108 podStartE2EDuration="23.804263215s" totalImagesPullingTime="6.763965107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:44:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:27.803136538 +0000 UTC m=+91.891641576" watchObservedRunningTime="2026-07-06 20:44:27.804263215 +0000 UTC m=+91.892768250" Jul 06 20:44:29.750524 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:29.750465 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9r5rz\" (UID: \"14b6e54d-55ec-4e9b-8363-cbb12e017b88\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" Jul 06 20:44:29.752989 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:29.752961 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/14b6e54d-55ec-4e9b-8363-cbb12e017b88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-9r5rz\" (UID: \"14b6e54d-55ec-4e9b-8363-cbb12e017b88\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" Jul 06 20:44:29.997491 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:29.997454 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" Jul 06 20:44:30.132197 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:30.132160 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz"] Jul 06 20:44:30.135590 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:44:30.135544 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14b6e54d_55ec_4e9b_8363_cbb12e017b88.slice/crio-dd6cbc7990b139db3660950c14117e4ab13bd505237e75b70efdef4e0cdbdc17 WatchSource:0}: Error finding container dd6cbc7990b139db3660950c14117e4ab13bd505237e75b70efdef4e0cdbdc17: Status 404 returned error can't find the container with id dd6cbc7990b139db3660950c14117e4ab13bd505237e75b70efdef4e0cdbdc17 Jul 06 20:44:30.784902 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:30.784858 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" event={"ID":"14b6e54d-55ec-4e9b-8363-cbb12e017b88","Type":"ContainerStarted","Data":"dd6cbc7990b139db3660950c14117e4ab13bd505237e75b70efdef4e0cdbdc17"} Jul 06 20:44:32.793326 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:32.793292 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" event={"ID":"14b6e54d-55ec-4e9b-8363-cbb12e017b88","Type":"ContainerStarted","Data":"b8929564a941cd24b12598c970b07275af0d0a0e5d57fea2742ae425a114b730"} Jul 06 20:44:35.806981 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.806919 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-9r5rz" podStartSLOduration=36.71014133 podStartE2EDuration="38.806896273s" totalImagesPullingTime="2.096754943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:43:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:32.817920475 +0000 UTC m=+96.906425514" watchObservedRunningTime="2026-07-06 20:44:35.806896273 +0000 UTC m=+99.895401313" Jul 06 20:44:35.807766 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.807744 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv"] Jul 06 20:44:35.812542 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.812519 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv" Jul 06 20:44:35.816809 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.816786 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 20:44:35.817640 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.817616 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 06 20:44:35.817749 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.817659 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 20:44:35.817867 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.817848 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 20:44:35.831020 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.830992 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv"] Jul 06 20:44:35.906283 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.906244 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2f4c6290-c4fd-4788-868d-6d168137d9d0-klusterlet-config\") pod \"klusterlet-addon-workmgr-57bb7d7446-m6wmv\" (UID: \"2f4c6290-c4fd-4788-868d-6d168137d9d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv" Jul 06 20:44:35.906448 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.906300 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88hd6\" (UniqueName: \"kubernetes.io/projected/2f4c6290-c4fd-4788-868d-6d168137d9d0-kube-api-access-88hd6\") pod \"klusterlet-addon-workmgr-57bb7d7446-m6wmv\" (UID: \"2f4c6290-c4fd-4788-868d-6d168137d9d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv" Jul 06 20:44:35.906448 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.906404 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f4c6290-c4fd-4788-868d-6d168137d9d0-tmp\") pod \"klusterlet-addon-workmgr-57bb7d7446-m6wmv\" (UID: \"2f4c6290-c4fd-4788-868d-6d168137d9d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv" Jul 06 20:44:35.909718 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.909693 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b65547c9b-cpktn"] Jul 06 20:44:35.913425 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.913409 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dghl8"] Jul 06 20:44:35.913563 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.913546 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:35.916730 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.916702 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dghl8" Jul 06 20:44:35.918401 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.918381 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 20:44:35.918499 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.918462 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 20:44:35.919335 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.919310 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 20:44:35.919447 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.919424 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2phbz\"" Jul 06 20:44:35.919596 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.919576 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rr4fq\"" Jul 06 20:44:35.919596 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.919589 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 20:44:35.919811 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.919621 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 20:44:35.920540 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.920380 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 20:44:35.920745 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.920723 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 20:44:35.922510 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.922494 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 20:44:35.925073 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.925036 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dghl8"] Jul 06 20:44:35.932001 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:35.931979 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b65547c9b-cpktn"] Jul 06 20:44:36.007441 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.007403 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj5nm\" (UniqueName: \"kubernetes.io/projected/9c1555f0-3134-47b0-a95d-c92e215651ba-kube-api-access-dj5nm\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.007637 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.007470 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-console-config\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.007637 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.007505 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-oauth-serving-cert\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.007637 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.007526 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/390e85c0-1abd-4bd3-a8ff-d51f00660b11-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-dghl8\" (UID: \"390e85c0-1abd-4bd3-a8ff-d51f00660b11\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dghl8" Jul 06 20:44:36.007637 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.007550 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c1555f0-3134-47b0-a95d-c92e215651ba-console-serving-cert\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.007637 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.007582 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-service-ca\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.007637 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.007634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2f4c6290-c4fd-4788-868d-6d168137d9d0-klusterlet-config\") pod \"klusterlet-addon-workmgr-57bb7d7446-m6wmv\" (UID: \"2f4c6290-c4fd-4788-868d-6d168137d9d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv" Jul 06 20:44:36.007884 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.007669 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c1555f0-3134-47b0-a95d-c92e215651ba-console-oauth-config\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.007884 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.007700 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88hd6\" (UniqueName: \"kubernetes.io/projected/2f4c6290-c4fd-4788-868d-6d168137d9d0-kube-api-access-88hd6\") pod \"klusterlet-addon-workmgr-57bb7d7446-m6wmv\" (UID: \"2f4c6290-c4fd-4788-868d-6d168137d9d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv" Jul 06 20:44:36.007884 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.007732 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f4c6290-c4fd-4788-868d-6d168137d9d0-tmp\") pod \"klusterlet-addon-workmgr-57bb7d7446-m6wmv\" (UID: \"2f4c6290-c4fd-4788-868d-6d168137d9d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv" Jul 06 20:44:36.008204 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.008173 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f4c6290-c4fd-4788-868d-6d168137d9d0-tmp\") pod \"klusterlet-addon-workmgr-57bb7d7446-m6wmv\" (UID: \"2f4c6290-c4fd-4788-868d-6d168137d9d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv" Jul 06 20:44:36.010296 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.010274 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/2f4c6290-c4fd-4788-868d-6d168137d9d0-klusterlet-config\") pod \"klusterlet-addon-workmgr-57bb7d7446-m6wmv\" (UID: \"2f4c6290-c4fd-4788-868d-6d168137d9d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv" Jul 06 20:44:36.040786 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.040754 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88hd6\" (UniqueName: \"kubernetes.io/projected/2f4c6290-c4fd-4788-868d-6d168137d9d0-kube-api-access-88hd6\") pod \"klusterlet-addon-workmgr-57bb7d7446-m6wmv\" (UID: \"2f4c6290-c4fd-4788-868d-6d168137d9d0\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv" Jul 06 20:44:36.109002 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.108969 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj5nm\" (UniqueName: \"kubernetes.io/projected/9c1555f0-3134-47b0-a95d-c92e215651ba-kube-api-access-dj5nm\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.109138 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.109026 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-console-config\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.109138 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.109074 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-oauth-serving-cert\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.109138 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.109097 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/390e85c0-1abd-4bd3-a8ff-d51f00660b11-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-dghl8\" (UID: \"390e85c0-1abd-4bd3-a8ff-d51f00660b11\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dghl8" Jul 06 20:44:36.109138 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.109114 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c1555f0-3134-47b0-a95d-c92e215651ba-console-serving-cert\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.109336 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.109137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-service-ca\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.109336 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.109176 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c1555f0-3134-47b0-a95d-c92e215651ba-console-oauth-config\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.109913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.109868 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-console-config\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.110001 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.109919 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-service-ca\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.110001 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.109942 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-oauth-serving-cert\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.111612 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.111593 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c1555f0-3134-47b0-a95d-c92e215651ba-console-serving-cert\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.112100 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.112074 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/390e85c0-1abd-4bd3-a8ff-d51f00660b11-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-dghl8\" (UID: \"390e85c0-1abd-4bd3-a8ff-d51f00660b11\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dghl8" Jul 06 20:44:36.112185 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.112096 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c1555f0-3134-47b0-a95d-c92e215651ba-console-oauth-config\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.120819 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.120797 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj5nm\" (UniqueName: \"kubernetes.io/projected/9c1555f0-3134-47b0-a95d-c92e215651ba-kube-api-access-dj5nm\") pod \"console-b65547c9b-cpktn\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.121545 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.121529 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv" Jul 06 20:44:36.223752 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.223703 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:36.229336 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.229309 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dghl8" Jul 06 20:44:36.258004 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.257973 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv"] Jul 06 20:44:36.262017 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:44:36.261982 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f4c6290_c4fd_4788_868d_6d168137d9d0.slice/crio-a1e9267428a315cf0c7707909966cd9fe457130af6ed181a9fed703db7c6d08c WatchSource:0}: Error finding container a1e9267428a315cf0c7707909966cd9fe457130af6ed181a9fed703db7c6d08c: Status 404 returned error can't find the container with id a1e9267428a315cf0c7707909966cd9fe457130af6ed181a9fed703db7c6d08c Jul 06 20:44:36.375102 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.375005 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b65547c9b-cpktn"] Jul 06 20:44:36.378217 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:44:36.378182 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c1555f0_3134_47b0_a95d_c92e215651ba.slice/crio-ecb6286bd89a065413f32dd4d4c97c153a1f7808c493b4a310a4be4e84cc095d WatchSource:0}: Error finding container ecb6286bd89a065413f32dd4d4c97c153a1f7808c493b4a310a4be4e84cc095d: Status 404 returned error can't find the container with id ecb6286bd89a065413f32dd4d4c97c153a1f7808c493b4a310a4be4e84cc095d Jul 06 20:44:36.398748 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.398731 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dghl8"] Jul 06 20:44:36.401216 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:44:36.401189 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod390e85c0_1abd_4bd3_a8ff_d51f00660b11.slice/crio-f950efafa9c107d73e90365c54b9c8d279575fe91c47f32aa36d9c9511c9ee3b WatchSource:0}: Error finding container f950efafa9c107d73e90365c54b9c8d279575fe91c47f32aa36d9c9511c9ee3b: Status 404 returned error can't find the container with id f950efafa9c107d73e90365c54b9c8d279575fe91c47f32aa36d9c9511c9ee3b Jul 06 20:44:36.807343 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.807244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b65547c9b-cpktn" event={"ID":"9c1555f0-3134-47b0-a95d-c92e215651ba","Type":"ContainerStarted","Data":"ecb6286bd89a065413f32dd4d4c97c153a1f7808c493b4a310a4be4e84cc095d"} Jul 06 20:44:36.808324 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.808298 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv" event={"ID":"2f4c6290-c4fd-4788-868d-6d168137d9d0","Type":"ContainerStarted","Data":"a1e9267428a315cf0c7707909966cd9fe457130af6ed181a9fed703db7c6d08c"} Jul 06 20:44:36.809311 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:36.809288 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dghl8" event={"ID":"390e85c0-1abd-4bd3-a8ff-d51f00660b11","Type":"ContainerStarted","Data":"f950efafa9c107d73e90365c54b9c8d279575fe91c47f32aa36d9c9511c9ee3b"} Jul 06 20:44:37.724664 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:37.723974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:44:37.724664 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:37.724120 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:44:37.727674 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:37.727628 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls\") pod \"image-registry-687fcd985d-h48tz\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:44:37.735854 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:37.735826 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5030b055-0d90-462d-896c-b8de4f05030b-metrics-tls\") pod \"dns-default-hz7nr\" (UID: \"5030b055-0d90-462d-896c-b8de4f05030b\") " pod="openshift-dns/dns-default-hz7nr" Jul 06 20:44:38.013240 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:38.013118 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mzdrj\"" Jul 06 20:44:38.015191 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:38.015168 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qchpv\"" Jul 06 20:44:38.018620 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:38.018566 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:44:38.020875 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:38.020844 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hz7nr" Jul 06 20:44:39.086744 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:39.086683 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hz7nr"] Jul 06 20:44:39.114802 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:39.114697 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-687fcd985d-h48tz"] Jul 06 20:44:39.709492 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:39.709460 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-trdb7" Jul 06 20:44:39.824441 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:39.824403 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dghl8" event={"ID":"390e85c0-1abd-4bd3-a8ff-d51f00660b11","Type":"ContainerStarted","Data":"31941123d8e75e88e76b17d7b07731b40bedff58c4cf68cdaa6a4e9b08545645"} Jul 06 20:44:39.824647 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:39.824629 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dghl8" Jul 06 20:44:39.830530 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:39.830497 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dghl8" Jul 06 20:44:39.843522 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:39.843459 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dghl8" podStartSLOduration=2.327548695 podStartE2EDuration="4.843436047s" totalImagesPullingTime="2.515887352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:39.842527568 +0000 UTC m=+103.931032606" watchObservedRunningTime="2026-07-06 20:44:39.843436047 +0000 UTC m=+103.931941085" Jul 06 20:44:40.213246 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:44:40.213212 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5030b055_0d90_462d_896c_b8de4f05030b.slice/crio-b43276191cf28a98f6f6401692f961d3ed05cf22d616adc1c64a7627db3d6167 WatchSource:0}: Error finding container b43276191cf28a98f6f6401692f961d3ed05cf22d616adc1c64a7627db3d6167: Status 404 returned error can't find the container with id b43276191cf28a98f6f6401692f961d3ed05cf22d616adc1c64a7627db3d6167 Jul 06 20:44:40.828840 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:40.828803 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hz7nr" event={"ID":"5030b055-0d90-462d-896c-b8de4f05030b","Type":"ContainerStarted","Data":"b43276191cf28a98f6f6401692f961d3ed05cf22d616adc1c64a7627db3d6167"} Jul 06 20:44:40.901922 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:40.901890 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm"] Jul 06 20:44:40.918556 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:40.918526 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm"] Jul 06 20:44:40.918743 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:40.918656 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" Jul 06 20:44:40.921789 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:40.921527 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 20:44:40.921789 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:40.921534 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 20:44:40.921789 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:40.921587 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ndfwp\"" Jul 06 20:44:40.923253 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:40.923226 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 20:44:40.950836 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:40.950801 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7915952c-d4c6-4a33-b340-fa755c89137c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4j4nm\" (UID: \"7915952c-d4c6-4a33-b340-fa755c89137c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" Jul 06 20:44:40.951016 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:40.950882 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtfck\" (UniqueName: \"kubernetes.io/projected/7915952c-d4c6-4a33-b340-fa755c89137c-kube-api-access-xtfck\") pod \"prometheus-operator-567f7b8b7c-4j4nm\" (UID: \"7915952c-d4c6-4a33-b340-fa755c89137c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" Jul 06 20:44:40.951016 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:40.950938 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7915952c-d4c6-4a33-b340-fa755c89137c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4j4nm\" (UID: \"7915952c-d4c6-4a33-b340-fa755c89137c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" Jul 06 20:44:40.951016 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:40.950970 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7915952c-d4c6-4a33-b340-fa755c89137c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4j4nm\" (UID: \"7915952c-d4c6-4a33-b340-fa755c89137c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" Jul 06 20:44:41.051364 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:41.051314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7915952c-d4c6-4a33-b340-fa755c89137c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4j4nm\" (UID: \"7915952c-d4c6-4a33-b340-fa755c89137c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" Jul 06 20:44:41.051364 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:41.051360 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7915952c-d4c6-4a33-b340-fa755c89137c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4j4nm\" (UID: \"7915952c-d4c6-4a33-b340-fa755c89137c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" Jul 06 20:44:41.051598 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:41.051433 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7915952c-d4c6-4a33-b340-fa755c89137c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4j4nm\" (UID: \"7915952c-d4c6-4a33-b340-fa755c89137c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" Jul 06 20:44:41.051598 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:41.051491 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtfck\" (UniqueName: \"kubernetes.io/projected/7915952c-d4c6-4a33-b340-fa755c89137c-kube-api-access-xtfck\") pod \"prometheus-operator-567f7b8b7c-4j4nm\" (UID: \"7915952c-d4c6-4a33-b340-fa755c89137c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" Jul 06 20:44:41.052329 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:41.052298 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7915952c-d4c6-4a33-b340-fa755c89137c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4j4nm\" (UID: \"7915952c-d4c6-4a33-b340-fa755c89137c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" Jul 06 20:44:41.054130 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:41.054107 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7915952c-d4c6-4a33-b340-fa755c89137c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4j4nm\" (UID: \"7915952c-d4c6-4a33-b340-fa755c89137c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" Jul 06 20:44:41.054300 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:41.054277 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7915952c-d4c6-4a33-b340-fa755c89137c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4j4nm\" (UID: \"7915952c-d4c6-4a33-b340-fa755c89137c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" Jul 06 20:44:41.060578 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:41.060555 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtfck\" (UniqueName: \"kubernetes.io/projected/7915952c-d4c6-4a33-b340-fa755c89137c-kube-api-access-xtfck\") pod \"prometheus-operator-567f7b8b7c-4j4nm\" (UID: \"7915952c-d4c6-4a33-b340-fa755c89137c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" Jul 06 20:44:41.232070 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:41.232025 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" Jul 06 20:44:41.425200 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:44:41.425172 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f67bcb_0f08_4a4f_ae52_efe4d2735264.slice/crio-093cb3ff66b460cc1aa5438816a9c9a72d98fb13b19d8792c28d4de2e1a67009 WatchSource:0}: Error finding container 093cb3ff66b460cc1aa5438816a9c9a72d98fb13b19d8792c28d4de2e1a67009: Status 404 returned error can't find the container with id 093cb3ff66b460cc1aa5438816a9c9a72d98fb13b19d8792c28d4de2e1a67009 Jul 06 20:44:41.834464 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:41.834418 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-687fcd985d-h48tz" event={"ID":"93f67bcb-0f08-4a4f-ae52-efe4d2735264","Type":"ContainerStarted","Data":"093cb3ff66b460cc1aa5438816a9c9a72d98fb13b19d8792c28d4de2e1a67009"} Jul 06 20:44:42.058509 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:42.058471 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm"] Jul 06 20:44:42.064158 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:44:42.064128 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7915952c_d4c6_4a33_b340_fa755c89137c.slice/crio-165a79627410e42bc886f60a96e5a11bb4f8ee8b37e79c59b558cfda244bae75 WatchSource:0}: Error finding container 165a79627410e42bc886f60a96e5a11bb4f8ee8b37e79c59b558cfda244bae75: Status 404 returned error can't find the container with id 165a79627410e42bc886f60a96e5a11bb4f8ee8b37e79c59b558cfda244bae75 Jul 06 20:44:42.840815 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:42.840747 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b65547c9b-cpktn" event={"ID":"9c1555f0-3134-47b0-a95d-c92e215651ba","Type":"ContainerStarted","Data":"b2ed6570391ff72f5da6301ec3607d0240e3271b58e6f3d40d5ecf570712dbf3"} Jul 06 20:44:42.842604 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:42.842573 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv" event={"ID":"2f4c6290-c4fd-4788-868d-6d168137d9d0","Type":"ContainerStarted","Data":"d02305e391a9f97aa2683ce7c874ce57288954d816c3355b6b973ab9886ab422"} Jul 06 20:44:42.842751 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:42.842629 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv" Jul 06 20:44:42.845127 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:42.844513 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-687fcd985d-h48tz" event={"ID":"93f67bcb-0f08-4a4f-ae52-efe4d2735264","Type":"ContainerStarted","Data":"8be8bf345c09a2b3662439e3413b845bd4db465b0bf4291ad9ab77d85f6df3f2"} Jul 06 20:44:42.845127 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:42.844610 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv" Jul 06 20:44:42.845127 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:42.844807 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:44:42.845895 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:42.845873 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" event={"ID":"7915952c-d4c6-4a33-b340-fa755c89137c","Type":"ContainerStarted","Data":"165a79627410e42bc886f60a96e5a11bb4f8ee8b37e79c59b558cfda244bae75"} Jul 06 20:44:42.864750 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:42.864699 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b65547c9b-cpktn" podStartSLOduration=2.334510715 podStartE2EDuration="7.864683065s" totalImagesPullingTime="5.53017235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:42.863408841 +0000 UTC m=+106.951913879" watchObservedRunningTime="2026-07-06 20:44:42.864683065 +0000 UTC m=+106.953188106" Jul 06 20:44:42.884812 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:42.884748 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-57bb7d7446-m6wmv" podStartSLOduration=2.21886377 podStartE2EDuration="7.884726371s" totalImagesPullingTime="5.665862601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:42.884304994 +0000 UTC m=+106.972810045" watchObservedRunningTime="2026-07-06 20:44:42.884726371 +0000 UTC m=+106.973231409" Jul 06 20:44:42.913932 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:42.913868 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-687fcd985d-h48tz" podStartSLOduration=104.913846787 podStartE2EDuration="1m44.913846787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:42:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:42.91223704 +0000 UTC m=+107.000742091" watchObservedRunningTime="2026-07-06 20:44:42.913846787 +0000 UTC m=+107.002351827" Jul 06 20:44:43.851703 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:43.851660 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hz7nr" event={"ID":"5030b055-0d90-462d-896c-b8de4f05030b","Type":"ContainerStarted","Data":"5c906008a24035b568955ddd24c79dd8d6b0a856993dfac056465bab5152638d"} Jul 06 20:44:43.852160 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:43.851756 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hz7nr" event={"ID":"5030b055-0d90-462d-896c-b8de4f05030b","Type":"ContainerStarted","Data":"f743d80a00c9894e234b2faae3c1e09b2d1fc63844d6b93bfd786e66678a5e69"} Jul 06 20:44:43.852160 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:43.851804 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hz7nr" Jul 06 20:44:43.853451 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:43.853421 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" event={"ID":"7915952c-d4c6-4a33-b340-fa755c89137c","Type":"ContainerStarted","Data":"6cdce3b66a925681aeb8728a5d867fb257aaaa9c3889901721459ba31f7f860d"} Jul 06 20:44:43.853562 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:43.853467 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" event={"ID":"7915952c-d4c6-4a33-b340-fa755c89137c","Type":"ContainerStarted","Data":"37c4824838ed4322ad2a9ff6ff2a203d41543b0ec6d4b6eb1fd4304ccc3ec84a"} Jul 06 20:44:43.873473 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:43.873428 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hz7nr" podStartSLOduration=67.858742425 podStartE2EDuration="1m10.873414017s" totalImagesPullingTime="3.014671592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:43:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:43.871896508 +0000 UTC m=+107.960401547" watchObservedRunningTime="2026-07-06 20:44:43.873414017 +0000 UTC m=+107.961919054" Jul 06 20:44:43.894018 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:43.893948 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4j4nm" podStartSLOduration=2.276599043 podStartE2EDuration="3.89392631s" totalImagesPullingTime="1.617327267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:44:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:43.891996661 +0000 UTC m=+107.980501701" watchObservedRunningTime="2026-07-06 20:44:43.89392631 +0000 UTC m=+107.982431365" Jul 06 20:44:46.224141 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.224089 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:46.224523 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.224179 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:46.229269 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.229242 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:46.366139 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.366104 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vjrqn"] Jul 06 20:44:46.368305 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.368284 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.371087 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.371061 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 20:44:46.371185 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.371090 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 20:44:46.371185 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.371037 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j6l6n\"" Jul 06 20:44:46.371405 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.371392 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 20:44:46.397552 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.397520 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30282de3-cd34-4069-b411-efcc6a566e35-root\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.397696 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.397559 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30282de3-cd34-4069-b411-efcc6a566e35-node-exporter-wtmp\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.397696 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.397584 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30282de3-cd34-4069-b411-efcc6a566e35-node-exporter-accelerators-collector-config\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.397696 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.397664 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30282de3-cd34-4069-b411-efcc6a566e35-node-exporter-tls\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.397696 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.397690 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30282de3-cd34-4069-b411-efcc6a566e35-metrics-client-ca\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.397846 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.397715 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30282de3-cd34-4069-b411-efcc6a566e35-node-exporter-textfile\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.397846 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.397754 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30282de3-cd34-4069-b411-efcc6a566e35-sys\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.397846 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.397775 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2khn\" (UniqueName: \"kubernetes.io/projected/30282de3-cd34-4069-b411-efcc6a566e35-kube-api-access-v2khn\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.397846 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.397809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30282de3-cd34-4069-b411-efcc6a566e35-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.498998 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.498906 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30282de3-cd34-4069-b411-efcc6a566e35-node-exporter-wtmp\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.498998 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.498952 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30282de3-cd34-4069-b411-efcc6a566e35-node-exporter-accelerators-collector-config\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.498998 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.498984 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30282de3-cd34-4069-b411-efcc6a566e35-node-exporter-tls\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.498998 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.498999 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30282de3-cd34-4069-b411-efcc6a566e35-metrics-client-ca\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.499309 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.499019 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30282de3-cd34-4069-b411-efcc6a566e35-node-exporter-textfile\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.499309 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.499065 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30282de3-cd34-4069-b411-efcc6a566e35-sys\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.499309 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.499097 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2khn\" (UniqueName: \"kubernetes.io/projected/30282de3-cd34-4069-b411-efcc6a566e35-kube-api-access-v2khn\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.499309 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.499128 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30282de3-cd34-4069-b411-efcc6a566e35-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.499309 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.499127 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30282de3-cd34-4069-b411-efcc6a566e35-node-exporter-wtmp\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.499309 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.499154 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30282de3-cd34-4069-b411-efcc6a566e35-root\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.499309 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.499164 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30282de3-cd34-4069-b411-efcc6a566e35-sys\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.499309 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.499225 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30282de3-cd34-4069-b411-efcc6a566e35-root\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.499669 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.499487 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30282de3-cd34-4069-b411-efcc6a566e35-node-exporter-textfile\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.499669 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.499640 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30282de3-cd34-4069-b411-efcc6a566e35-metrics-client-ca\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.499669 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.499662 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30282de3-cd34-4069-b411-efcc6a566e35-node-exporter-accelerators-collector-config\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.501579 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.501557 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30282de3-cd34-4069-b411-efcc6a566e35-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.501735 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.501714 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30282de3-cd34-4069-b411-efcc6a566e35-node-exporter-tls\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.521637 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.521606 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2khn\" (UniqueName: \"kubernetes.io/projected/30282de3-cd34-4069-b411-efcc6a566e35-kube-api-access-v2khn\") pod \"node-exporter-vjrqn\" (UID: \"30282de3-cd34-4069-b411-efcc6a566e35\") " pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.677709 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.677674 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vjrqn" Jul 06 20:44:46.687534 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:44:46.687495 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30282de3_cd34_4069_b411_efcc6a566e35.slice/crio-ec0da64cb358d7b815c85ee8ccf7a5415673d5019e4b57297d60e524733b1d20 WatchSource:0}: Error finding container ec0da64cb358d7b815c85ee8ccf7a5415673d5019e4b57297d60e524733b1d20: Status 404 returned error can't find the container with id ec0da64cb358d7b815c85ee8ccf7a5415673d5019e4b57297d60e524733b1d20 Jul 06 20:44:46.864707 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.864671 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vjrqn" event={"ID":"30282de3-cd34-4069-b411-efcc6a566e35","Type":"ContainerStarted","Data":"ec0da64cb358d7b815c85ee8ccf7a5415673d5019e4b57297d60e524733b1d20"} Jul 06 20:44:46.868530 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:46.868509 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:44:47.381492 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.381450 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:44:47.385426 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.385402 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.389005 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.388975 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 20:44:47.389863 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.389835 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 20:44:47.390370 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.390235 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 20:44:47.390370 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.390241 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 20:44:47.390370 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.390293 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 20:44:47.390370 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.390244 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 20:44:47.390724 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.390705 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 20:44:47.390855 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.390814 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5bjtg\"" Jul 06 20:44:47.390918 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.390725 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 20:44:47.390918 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.390770 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 20:44:47.407198 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.407173 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-web-config\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.407345 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.407219 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.407345 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.407276 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.407345 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.407308 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ecac5f3a-6202-4f38-a57d-301b665f4045-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.407345 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.407333 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ecac5f3a-6202-4f38-a57d-301b665f4045-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.407532 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.407389 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ecac5f3a-6202-4f38-a57d-301b665f4045-config-out\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.407532 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.407413 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecac5f3a-6202-4f38-a57d-301b665f4045-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.407532 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.407440 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.407532 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.407498 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-config-volume\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.407532 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.407520 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.407684 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.407540 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4prf2\" (UniqueName: \"kubernetes.io/projected/ecac5f3a-6202-4f38-a57d-301b665f4045-kube-api-access-4prf2\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.407684 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.407559 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.407684 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.407575 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecac5f3a-6202-4f38-a57d-301b665f4045-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.417452 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.417424 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:44:47.508174 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.508142 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-web-config\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.508174 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.508187 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.508410 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.508231 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.508410 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.508264 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ecac5f3a-6202-4f38-a57d-301b665f4045-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.508410 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.508295 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ecac5f3a-6202-4f38-a57d-301b665f4045-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.508410 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.508332 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ecac5f3a-6202-4f38-a57d-301b665f4045-config-out\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.508410 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.508359 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecac5f3a-6202-4f38-a57d-301b665f4045-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.508410 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.508386 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.508726 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.508420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-config-volume\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.508726 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.508445 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.508726 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.508482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4prf2\" (UniqueName: \"kubernetes.io/projected/ecac5f3a-6202-4f38-a57d-301b665f4045-kube-api-access-4prf2\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.508726 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.508514 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.508726 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.508549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecac5f3a-6202-4f38-a57d-301b665f4045-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.510087 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.508864 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ecac5f3a-6202-4f38-a57d-301b665f4045-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.510087 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.509787 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecac5f3a-6202-4f38-a57d-301b665f4045-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.510087 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.509885 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecac5f3a-6202-4f38-a57d-301b665f4045-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.512699 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.512657 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.513285 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.513226 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-config-volume\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.513383 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.513299 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ecac5f3a-6202-4f38-a57d-301b665f4045-config-out\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.513383 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.513302 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ecac5f3a-6202-4f38-a57d-301b665f4045-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.513488 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.513436 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-web-config\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.513963 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.513921 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.514063 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.514009 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.514438 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.514417 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.514918 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.514895 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.523456 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.523432 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4prf2\" (UniqueName: \"kubernetes.io/projected/ecac5f3a-6202-4f38-a57d-301b665f4045-kube-api-access-4prf2\") pod \"alertmanager-main-0\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.699800 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.699688 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:44:47.963650 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:47.963623 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:44:47.965080 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:44:47.965027 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecac5f3a_6202_4f38_a57d_301b665f4045.slice/crio-f5e10aeeceb56bb0fb1f5b85f2783c07ede442d6c371badb0ccfe5d72ac0ef1a WatchSource:0}: Error finding container f5e10aeeceb56bb0fb1f5b85f2783c07ede442d6c371badb0ccfe5d72ac0ef1a: Status 404 returned error can't find the container with id f5e10aeeceb56bb0fb1f5b85f2783c07ede442d6c371badb0ccfe5d72ac0ef1a Jul 06 20:44:48.874618 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:48.874579 2579 generic.go:356] "Generic (PLEG): container finished" podID="30282de3-cd34-4069-b411-efcc6a566e35" containerID="beaa8a494826b9ffcae97150c67cdf490a78f772617f821a0451924a5c56d04c" exitCode=0 Jul 06 20:44:48.875104 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:48.874667 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vjrqn" event={"ID":"30282de3-cd34-4069-b411-efcc6a566e35","Type":"ContainerDied","Data":"beaa8a494826b9ffcae97150c67cdf490a78f772617f821a0451924a5c56d04c"} Jul 06 20:44:48.876093 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:48.876067 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecac5f3a-6202-4f38-a57d-301b665f4045","Type":"ContainerStarted","Data":"f5e10aeeceb56bb0fb1f5b85f2783c07ede442d6c371badb0ccfe5d72ac0ef1a"} Jul 06 20:44:49.379144 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.379106 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-b448b585b-twbg9"] Jul 06 20:44:49.382720 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.382697 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.385559 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.385534 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 20:44:49.386290 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.386269 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a0pq96q834k9d\"" Jul 06 20:44:49.386460 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.386270 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xtbsm\"" Jul 06 20:44:49.386460 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.386270 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 20:44:49.386460 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.386440 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 20:44:49.386654 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.386640 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 20:44:49.386846 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.386831 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 20:44:49.398553 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.398518 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b448b585b-twbg9"] Jul 06 20:44:49.426099 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.426004 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.426099 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.426082 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-metrics-client-ca\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.426280 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.426115 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.426280 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.426153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-grpc-tls\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.426280 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.426216 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-thanos-querier-tls\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.426280 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.426271 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp7cp\" (UniqueName: \"kubernetes.io/projected/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-kube-api-access-kp7cp\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.426398 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.426319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.426398 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.426366 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.469999 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.469965 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b65547c9b-cpktn"] Jul 06 20:44:49.526965 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.526930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-metrics-client-ca\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.527164 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.526979 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.527164 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.527016 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-grpc-tls\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.527164 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.527096 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-thanos-querier-tls\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.527164 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.527126 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp7cp\" (UniqueName: \"kubernetes.io/projected/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-kube-api-access-kp7cp\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.527164 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.527149 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.527409 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.527171 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.527409 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.527217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.527855 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.527816 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-metrics-client-ca\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.530006 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.529969 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.530127 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.530112 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.530248 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.530225 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.530380 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.530361 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-grpc-tls\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.530511 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.530406 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-thanos-querier-tls\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.530625 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.530607 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.536865 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.536842 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp7cp\" (UniqueName: \"kubernetes.io/projected/9a46c23b-7aa8-46c0-9b13-bc7d847c06d9-kube-api-access-kp7cp\") pod \"thanos-querier-b448b585b-twbg9\" (UID: \"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9\") " pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.691901 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.691822 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:49.831192 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.831164 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-b448b585b-twbg9"] Jul 06 20:44:49.833352 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:44:49.833319 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a46c23b_7aa8_46c0_9b13_bc7d847c06d9.slice/crio-2c6cff7cc19bd4c9cee5614d42d39370a736dab0eae369aff87e2be6f2b4dd99 WatchSource:0}: Error finding container 2c6cff7cc19bd4c9cee5614d42d39370a736dab0eae369aff87e2be6f2b4dd99: Status 404 returned error can't find the container with id 2c6cff7cc19bd4c9cee5614d42d39370a736dab0eae369aff87e2be6f2b4dd99 Jul 06 20:44:49.881631 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.881593 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" event={"ID":"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9","Type":"ContainerStarted","Data":"2c6cff7cc19bd4c9cee5614d42d39370a736dab0eae369aff87e2be6f2b4dd99"} Jul 06 20:44:49.883652 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.883619 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vjrqn" event={"ID":"30282de3-cd34-4069-b411-efcc6a566e35","Type":"ContainerStarted","Data":"0d382fbf6c2a902cade22380cfff0c3dce89520e4c3df90aec5727caec827c22"} Jul 06 20:44:49.883788 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.883678 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vjrqn" event={"ID":"30282de3-cd34-4069-b411-efcc6a566e35","Type":"ContainerStarted","Data":"e8e5ae8728d945528613380c9c01ef11363cf41bbe23d7f72fe5eda41837ca9b"} Jul 06 20:44:49.885092 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.885065 2579 generic.go:356] "Generic (PLEG): container finished" podID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerID="6c81f7c7bd7adae30ee7331da16646bada2f02051aed9a09632c8572edd88433" exitCode=0 Jul 06 20:44:49.885193 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.885117 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecac5f3a-6202-4f38-a57d-301b665f4045","Type":"ContainerDied","Data":"6c81f7c7bd7adae30ee7331da16646bada2f02051aed9a09632c8572edd88433"} Jul 06 20:44:49.927174 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:49.927024 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vjrqn" podStartSLOduration=2.681478036 podStartE2EDuration="3.927005603s" totalImagesPullingTime="1.180802571s" totalInitContainerRuntime="64.724996ms" isStatefulPod=true podCreationTimestamp="2026-07-06 20:44:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:49.92632968 +0000 UTC m=+114.014834718" watchObservedRunningTime="2026-07-06 20:44:49.927005603 +0000 UTC m=+114.015510642" Jul 06 20:44:52.667303 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.667257 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:44:52.673715 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.673689 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.676872 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.676843 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 20:44:52.677625 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.677604 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 20:44:52.677773 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.677738 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 20:44:52.678527 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.678504 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4cvlt04bur0sh\"" Jul 06 20:44:52.679152 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.678747 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 20:44:52.679152 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.678796 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 20:44:52.679152 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.678801 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 20:44:52.679152 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.679144 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 20:44:52.679878 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.679641 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2rd7r\"" Jul 06 20:44:52.679878 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.679676 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 20:44:52.679878 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.679721 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 20:44:52.679878 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.679757 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 20:44:52.680254 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.680222 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 20:44:52.680254 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.680234 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 20:44:52.680454 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.680429 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 20:44:52.684143 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.683968 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 20:44:52.685977 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.685954 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 20:44:52.701098 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.697657 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:44:52.758834 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.758802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.758932 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.758845 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.758932 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.758903 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.759062 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.758960 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.759126 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.759029 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dd4fd7e-236a-48f4-80dd-17a05f8298af-config-out\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.759182 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.759117 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-web-config\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.759182 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.759156 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.759182 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.759178 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dd4fd7e-236a-48f4-80dd-17a05f8298af-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.759324 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.759196 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.759324 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.759222 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.759324 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.759250 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.759324 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.759286 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.759526 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.759332 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-config\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.759526 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.759356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.759526 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.759377 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.759526 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.759393 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.759526 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.759409 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.759526 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.759430 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.759526 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.759466 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.759526 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.759484 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj8gz\" (UniqueName: \"kubernetes.io/projected/6dd4fd7e-236a-48f4-80dd-17a05f8298af-kube-api-access-lj8gz\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.860446 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.860339 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.860446 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.860402 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.860446 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.860441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-config\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.860723 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.860482 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.860723 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.860507 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.860723 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.860530 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.860723 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.860554 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.860723 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.860583 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.860723 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.860610 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.860723 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.860634 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj8gz\" (UniqueName: \"kubernetes.io/projected/6dd4fd7e-236a-48f4-80dd-17a05f8298af-kube-api-access-lj8gz\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.860723 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.860676 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.860723 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.860703 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.861220 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.860740 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.861220 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.860770 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.861220 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.860833 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dd4fd7e-236a-48f4-80dd-17a05f8298af-config-out\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.861220 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.860872 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-web-config\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.863062 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.861607 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.863062 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.861663 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.863062 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.861698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dd4fd7e-236a-48f4-80dd-17a05f8298af-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.863062 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.861723 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.863062 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.861751 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.863062 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.862074 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.863062 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.862183 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.863062 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.862451 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.863062 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.862919 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.863062 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.862923 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.864445 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.864328 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.865408 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.865361 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.865760 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.865731 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.866226 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.866201 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-web-config\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.866329 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.866306 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-config\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.866419 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.866403 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.866696 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.866677 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.867231 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.867201 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dd4fd7e-236a-48f4-80dd-17a05f8298af-config-out\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.867367 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.867347 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dd4fd7e-236a-48f4-80dd-17a05f8298af-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.867888 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.867863 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.868347 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.868325 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.868747 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.868729 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.868815 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.868794 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.871304 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.871282 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj8gz\" (UniqueName: \"kubernetes.io/projected/6dd4fd7e-236a-48f4-80dd-17a05f8298af-kube-api-access-lj8gz\") pod \"prometheus-k8s-0\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:52.902118 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.902079 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" event={"ID":"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9","Type":"ContainerStarted","Data":"d87e7610374bdf98e72a7b63acc25b4b6d7415e81202a62bdcc0dfa7fc56f60c"} Jul 06 20:44:52.902289 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.902170 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" event={"ID":"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9","Type":"ContainerStarted","Data":"bb3bbedc08bf3d24f316d3d22c5c4af987a2c2fa85a7b1fae80e34c77e0f63b5"} Jul 06 20:44:52.902289 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.902215 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" event={"ID":"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9","Type":"ContainerStarted","Data":"8721b10af3f70bcc37758684e45706ed7a57d85f4119022670649ac33de253fa"} Jul 06 20:44:52.906727 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.906694 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecac5f3a-6202-4f38-a57d-301b665f4045","Type":"ContainerStarted","Data":"c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f"} Jul 06 20:44:52.906897 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.906776 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecac5f3a-6202-4f38-a57d-301b665f4045","Type":"ContainerStarted","Data":"016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7"} Jul 06 20:44:52.906897 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.906822 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecac5f3a-6202-4f38-a57d-301b665f4045","Type":"ContainerStarted","Data":"7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819"} Jul 06 20:44:52.906897 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.906862 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecac5f3a-6202-4f38-a57d-301b665f4045","Type":"ContainerStarted","Data":"7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26"} Jul 06 20:44:52.906992 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.906901 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecac5f3a-6202-4f38-a57d-301b665f4045","Type":"ContainerStarted","Data":"bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a"} Jul 06 20:44:52.987439 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:52.987399 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:53.148539 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:53.148455 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:44:53.152333 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:44:53.152302 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dd4fd7e_236a_48f4_80dd_17a05f8298af.slice/crio-2b9bc6cd1ab49f3b57fd30beb76a27d2c586f1a12d17a1cfe623874655272cd4 WatchSource:0}: Error finding container 2b9bc6cd1ab49f3b57fd30beb76a27d2c586f1a12d17a1cfe623874655272cd4: Status 404 returned error can't find the container with id 2b9bc6cd1ab49f3b57fd30beb76a27d2c586f1a12d17a1cfe623874655272cd4 Jul 06 20:44:53.859910 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:53.859887 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hz7nr" Jul 06 20:44:53.914710 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:53.914672 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecac5f3a-6202-4f38-a57d-301b665f4045","Type":"ContainerStarted","Data":"4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089"} Jul 06 20:44:53.917304 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:53.917236 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" event={"ID":"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9","Type":"ContainerStarted","Data":"2d36f3478ebc2c5959d75b8221ee34b1a0ac4441f14f42cf231376426f2ce72d"} Jul 06 20:44:53.918934 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:53.918910 2579 generic.go:356] "Generic (PLEG): container finished" podID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerID="9b561f5cc69f8ed39f613de1ccc9f779b4c2a538f5e1af36de8a2c04d0027451" exitCode=0 Jul 06 20:44:53.919030 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:53.918969 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dd4fd7e-236a-48f4-80dd-17a05f8298af","Type":"ContainerDied","Data":"9b561f5cc69f8ed39f613de1ccc9f779b4c2a538f5e1af36de8a2c04d0027451"} Jul 06 20:44:53.919095 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:53.919068 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dd4fd7e-236a-48f4-80dd-17a05f8298af","Type":"ContainerStarted","Data":"2b9bc6cd1ab49f3b57fd30beb76a27d2c586f1a12d17a1cfe623874655272cd4"} Jul 06 20:44:53.946089 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:53.946019 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.283087694 podStartE2EDuration="6.946003175s" totalImagesPullingTime="4.642197292s" totalInitContainerRuntime="20.718189ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:44:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:53.945198993 +0000 UTC m=+118.033704050" watchObservedRunningTime="2026-07-06 20:44:53.946003175 +0000 UTC m=+118.034508213" Jul 06 20:44:54.927532 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:54.927482 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" event={"ID":"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9","Type":"ContainerStarted","Data":"4a25fd387c9e9ae2aab415bf5b26d0884bd65f1b89eeec2d9a86015b6823458b"} Jul 06 20:44:54.927987 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:54.927598 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" event={"ID":"9a46c23b-7aa8-46c0-9b13-bc7d847c06d9","Type":"ContainerStarted","Data":"bd82bd498d99ad8bb77af78deefda89e23dc95f271f3e46b3220eb079be98afb"} Jul 06 20:44:54.955517 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:54.955460 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" podStartSLOduration=2.325617066 podStartE2EDuration="5.955443859s" totalImagesPullingTime="3.629826793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:44:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:54.953869555 +0000 UTC m=+119.042374593" watchObservedRunningTime="2026-07-06 20:44:54.955443859 +0000 UTC m=+119.043948896" Jul 06 20:44:55.932351 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:55.932315 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:44:57.944367 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:57.944285 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dd4fd7e-236a-48f4-80dd-17a05f8298af","Type":"ContainerStarted","Data":"1ddee0ded363773c9a6884dbfe31319e74a761404934d5e1d01bf50b3ec99801"} Jul 06 20:44:57.944367 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:57.944355 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dd4fd7e-236a-48f4-80dd-17a05f8298af","Type":"ContainerStarted","Data":"342bd8819d84c96a1bed67c10933fe6e343be3846adb20e49ff7fe5f4f936491"} Jul 06 20:44:57.944807 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:57.944385 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dd4fd7e-236a-48f4-80dd-17a05f8298af","Type":"ContainerStarted","Data":"e4da94f4b9fd39d9f5392f8d559ee8837021b81a5b22ad81c89a46d8358456eb"} Jul 06 20:44:57.944807 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:57.944411 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dd4fd7e-236a-48f4-80dd-17a05f8298af","Type":"ContainerStarted","Data":"59aad0f7fd5981641d523e976ded4a99ad134a7cb2b58bc5895e56744d8931db"} Jul 06 20:44:57.944807 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:57.944436 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dd4fd7e-236a-48f4-80dd-17a05f8298af","Type":"ContainerStarted","Data":"a2681f6c69241bf3c6fead7b3f403015a39d5dbcb5b214f37f7187ff3625af77"} Jul 06 20:44:57.944807 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:57.944464 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dd4fd7e-236a-48f4-80dd-17a05f8298af","Type":"ContainerStarted","Data":"df9fcbeb3ccd869261f2e39e0dd74adb6121c0329d41b11ae11612dd445eaf4a"} Jul 06 20:44:57.979576 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:57.979510 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.471232051 podStartE2EDuration="5.979492721s" totalImagesPullingTime="3.491858721s" totalInitContainerRuntime="16.401949ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:44:57.9781098 +0000 UTC m=+122.066614838" watchObservedRunningTime="2026-07-06 20:44:57.979492721 +0000 UTC m=+122.067997759" Jul 06 20:44:57.988274 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:57.988246 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:44:58.395515 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:58.395481 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-687fcd985d-h48tz"] Jul 06 20:44:58.399790 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:44:58.399768 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:45:01.943719 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:01.943689 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-b448b585b-twbg9" Jul 06 20:45:07.200298 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:07.200236 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs\") pod \"network-metrics-daemon-4ktj2\" (UID: \"774becc8-6fe2-4ec6-aabf-a63925f4a0a6\") " pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:45:07.202629 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:07.202603 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/774becc8-6fe2-4ec6-aabf-a63925f4a0a6-metrics-certs\") pod \"network-metrics-daemon-4ktj2\" (UID: \"774becc8-6fe2-4ec6-aabf-a63925f4a0a6\") " pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:45:07.435280 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:07.435251 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqt4k\"" Jul 06 20:45:07.442338 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:07.442318 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ktj2" Jul 06 20:45:07.585728 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:07.585704 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4ktj2"] Jul 06 20:45:07.588512 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:45:07.588472 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774becc8_6fe2_4ec6_aabf_a63925f4a0a6.slice/crio-b6fc23156a25b26bcb8c1e1f7e4ea785ed0983b469c32a0c9a8f5bad6674af87 WatchSource:0}: Error finding container b6fc23156a25b26bcb8c1e1f7e4ea785ed0983b469c32a0c9a8f5bad6674af87: Status 404 returned error can't find the container with id b6fc23156a25b26bcb8c1e1f7e4ea785ed0983b469c32a0c9a8f5bad6674af87 Jul 06 20:45:07.991273 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:07.991236 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4ktj2" event={"ID":"774becc8-6fe2-4ec6-aabf-a63925f4a0a6","Type":"ContainerStarted","Data":"b6fc23156a25b26bcb8c1e1f7e4ea785ed0983b469c32a0c9a8f5bad6674af87"} Jul 06 20:45:08.996724 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:08.996638 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4ktj2" event={"ID":"774becc8-6fe2-4ec6-aabf-a63925f4a0a6","Type":"ContainerStarted","Data":"6828d4024cee9922cbd90a8ec40a72c44967ae6b4b0133c244ee839554939152"} Jul 06 20:45:08.996724 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:08.996691 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4ktj2" event={"ID":"774becc8-6fe2-4ec6-aabf-a63925f4a0a6","Type":"ContainerStarted","Data":"25e12f4f87779d811008a22cb7870acac20e9d0f02971d2334193eb673ba36b3"} Jul 06 20:45:09.015627 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:09.015576 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4ktj2" podStartSLOduration=129.945554859 podStartE2EDuration="2m11.015560772s" totalImagesPullingTime="1.070005913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:45:09.013918056 +0000 UTC m=+133.102423096" watchObservedRunningTime="2026-07-06 20:45:09.015560772 +0000 UTC m=+133.104065824" Jul 06 20:45:14.495656 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.495566 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b65547c9b-cpktn" podUID="9c1555f0-3134-47b0-a95d-c92e215651ba" containerName="console" containerID="cri-o://b2ed6570391ff72f5da6301ec3607d0240e3271b58e6f3d40d5ecf570712dbf3" gracePeriod=15 Jul 06 20:45:14.779876 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.779844 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:45:14.869069 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.869020 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-oauth-serving-cert\") pod \"9c1555f0-3134-47b0-a95d-c92e215651ba\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " Jul 06 20:45:14.869257 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.869115 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-service-ca\") pod \"9c1555f0-3134-47b0-a95d-c92e215651ba\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " Jul 06 20:45:14.869257 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.869144 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c1555f0-3134-47b0-a95d-c92e215651ba-console-oauth-config\") pod \"9c1555f0-3134-47b0-a95d-c92e215651ba\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " Jul 06 20:45:14.869257 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.869180 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-console-config\") pod \"9c1555f0-3134-47b0-a95d-c92e215651ba\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " Jul 06 20:45:14.869257 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.869204 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c1555f0-3134-47b0-a95d-c92e215651ba-console-serving-cert\") pod \"9c1555f0-3134-47b0-a95d-c92e215651ba\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " Jul 06 20:45:14.869257 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.869228 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dj5nm\" (UniqueName: \"kubernetes.io/projected/9c1555f0-3134-47b0-a95d-c92e215651ba-kube-api-access-dj5nm\") pod \"9c1555f0-3134-47b0-a95d-c92e215651ba\" (UID: \"9c1555f0-3134-47b0-a95d-c92e215651ba\") " Jul 06 20:45:14.869509 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.869483 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9c1555f0-3134-47b0-a95d-c92e215651ba" (UID: "9c1555f0-3134-47b0-a95d-c92e215651ba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:45:14.869608 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.869582 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-service-ca" (OuterVolumeSpecName: "service-ca") pod "9c1555f0-3134-47b0-a95d-c92e215651ba" (UID: "9c1555f0-3134-47b0-a95d-c92e215651ba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:45:14.869658 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.869620 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-console-config" (OuterVolumeSpecName: "console-config") pod "9c1555f0-3134-47b0-a95d-c92e215651ba" (UID: "9c1555f0-3134-47b0-a95d-c92e215651ba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:45:14.871456 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.871426 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c1555f0-3134-47b0-a95d-c92e215651ba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9c1555f0-3134-47b0-a95d-c92e215651ba" (UID: "9c1555f0-3134-47b0-a95d-c92e215651ba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:45:14.871573 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.871546 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c1555f0-3134-47b0-a95d-c92e215651ba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9c1555f0-3134-47b0-a95d-c92e215651ba" (UID: "9c1555f0-3134-47b0-a95d-c92e215651ba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:45:14.871636 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.871613 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c1555f0-3134-47b0-a95d-c92e215651ba-kube-api-access-dj5nm" (OuterVolumeSpecName: "kube-api-access-dj5nm") pod "9c1555f0-3134-47b0-a95d-c92e215651ba" (UID: "9c1555f0-3134-47b0-a95d-c92e215651ba"). InnerVolumeSpecName "kube-api-access-dj5nm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:45:14.969961 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.969926 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-service-ca\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:45:14.969961 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.969957 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c1555f0-3134-47b0-a95d-c92e215651ba-console-oauth-config\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:45:14.969961 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.969967 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-console-config\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:45:14.970195 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.969976 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c1555f0-3134-47b0-a95d-c92e215651ba-console-serving-cert\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:45:14.970195 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.969986 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dj5nm\" (UniqueName: \"kubernetes.io/projected/9c1555f0-3134-47b0-a95d-c92e215651ba-kube-api-access-dj5nm\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:45:14.970195 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:14.969995 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c1555f0-3134-47b0-a95d-c92e215651ba-oauth-serving-cert\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:45:15.023226 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:15.023139 2579 generic.go:356] "Generic (PLEG): container finished" podID="9c1555f0-3134-47b0-a95d-c92e215651ba" containerID="b2ed6570391ff72f5da6301ec3607d0240e3271b58e6f3d40d5ecf570712dbf3" exitCode=0 Jul 06 20:45:15.023226 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:15.023190 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b65547c9b-cpktn" Jul 06 20:45:15.023226 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:15.023202 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b65547c9b-cpktn" event={"ID":"9c1555f0-3134-47b0-a95d-c92e215651ba","Type":"ContainerDied","Data":"b2ed6570391ff72f5da6301ec3607d0240e3271b58e6f3d40d5ecf570712dbf3"} Jul 06 20:45:15.023418 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:15.023264 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b65547c9b-cpktn" event={"ID":"9c1555f0-3134-47b0-a95d-c92e215651ba","Type":"ContainerDied","Data":"ecb6286bd89a065413f32dd4d4c97c153a1f7808c493b4a310a4be4e84cc095d"} Jul 06 20:45:15.023418 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:15.023284 2579 scope.go:117] "RemoveContainer" containerID="b2ed6570391ff72f5da6301ec3607d0240e3271b58e6f3d40d5ecf570712dbf3" Jul 06 20:45:15.043278 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:15.043255 2579 scope.go:117] "RemoveContainer" containerID="b2ed6570391ff72f5da6301ec3607d0240e3271b58e6f3d40d5ecf570712dbf3" Jul 06 20:45:15.043563 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:45:15.043543 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2ed6570391ff72f5da6301ec3607d0240e3271b58e6f3d40d5ecf570712dbf3\": container with ID starting with b2ed6570391ff72f5da6301ec3607d0240e3271b58e6f3d40d5ecf570712dbf3 not found: ID does not exist" containerID="b2ed6570391ff72f5da6301ec3607d0240e3271b58e6f3d40d5ecf570712dbf3" Jul 06 20:45:15.043638 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:15.043606 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2ed6570391ff72f5da6301ec3607d0240e3271b58e6f3d40d5ecf570712dbf3"} err="failed to get container status \"b2ed6570391ff72f5da6301ec3607d0240e3271b58e6f3d40d5ecf570712dbf3\": rpc error: code = NotFound desc = could not find container \"b2ed6570391ff72f5da6301ec3607d0240e3271b58e6f3d40d5ecf570712dbf3\": container with ID starting with b2ed6570391ff72f5da6301ec3607d0240e3271b58e6f3d40d5ecf570712dbf3 not found: ID does not exist" Jul 06 20:45:15.045615 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:15.045593 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b65547c9b-cpktn"] Jul 06 20:45:15.051797 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:15.051773 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b65547c9b-cpktn"] Jul 06 20:45:15.424781 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:15.424750 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c1555f0-3134-47b0-a95d-c92e215651ba" path="/var/lib/kubelet/pods/9c1555f0-3134-47b0-a95d-c92e215651ba/volumes" Jul 06 20:45:19.501239 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:19.501205 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vwzxl_fbb6eb95-ccd2-43af-90e5-b33900e750af/serve-healthcheck-canary/0.log" Jul 06 20:45:23.415562 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.415522 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-687fcd985d-h48tz" podUID="93f67bcb-0f08-4a4f-ae52-efe4d2735264" containerName="registry" containerID="cri-o://8be8bf345c09a2b3662439e3413b845bd4db465b0bf4291ad9ab77d85f6df3f2" gracePeriod=30 Jul 06 20:45:23.658059 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.658020 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:45:23.848363 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.848324 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93f67bcb-0f08-4a4f-ae52-efe4d2735264-installation-pull-secrets\") pod \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " Jul 06 20:45:23.848533 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.848373 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-certificates\") pod \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " Jul 06 20:45:23.848533 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.848401 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls\") pod \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " Jul 06 20:45:23.848533 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.848432 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72qb4\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-kube-api-access-72qb4\") pod \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " Jul 06 20:45:23.848533 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.848464 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93f67bcb-0f08-4a4f-ae52-efe4d2735264-ca-trust-extracted\") pod \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " Jul 06 20:45:23.848533 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.848489 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93f67bcb-0f08-4a4f-ae52-efe4d2735264-trusted-ca\") pod \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " Jul 06 20:45:23.848815 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.848547 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93f67bcb-0f08-4a4f-ae52-efe4d2735264-image-registry-private-configuration\") pod \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " Jul 06 20:45:23.848815 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.848575 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-bound-sa-token\") pod \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\" (UID: \"93f67bcb-0f08-4a4f-ae52-efe4d2735264\") " Jul 06 20:45:23.848987 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.848955 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "93f67bcb-0f08-4a4f-ae52-efe4d2735264" (UID: "93f67bcb-0f08-4a4f-ae52-efe4d2735264"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:45:23.849199 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.849151 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93f67bcb-0f08-4a4f-ae52-efe4d2735264-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "93f67bcb-0f08-4a4f-ae52-efe4d2735264" (UID: "93f67bcb-0f08-4a4f-ae52-efe4d2735264"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:45:23.851031 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.851003 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "93f67bcb-0f08-4a4f-ae52-efe4d2735264" (UID: "93f67bcb-0f08-4a4f-ae52-efe4d2735264"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:45:23.851159 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.851035 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "93f67bcb-0f08-4a4f-ae52-efe4d2735264" (UID: "93f67bcb-0f08-4a4f-ae52-efe4d2735264"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:45:23.851159 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.851150 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f67bcb-0f08-4a4f-ae52-efe4d2735264-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "93f67bcb-0f08-4a4f-ae52-efe4d2735264" (UID: "93f67bcb-0f08-4a4f-ae52-efe4d2735264"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:45:23.851384 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.851356 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93f67bcb-0f08-4a4f-ae52-efe4d2735264-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "93f67bcb-0f08-4a4f-ae52-efe4d2735264" (UID: "93f67bcb-0f08-4a4f-ae52-efe4d2735264"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:45:23.851461 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.851427 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-kube-api-access-72qb4" (OuterVolumeSpecName: "kube-api-access-72qb4") pod "93f67bcb-0f08-4a4f-ae52-efe4d2735264" (UID: "93f67bcb-0f08-4a4f-ae52-efe4d2735264"). InnerVolumeSpecName "kube-api-access-72qb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:45:23.857555 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.857522 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93f67bcb-0f08-4a4f-ae52-efe4d2735264-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "93f67bcb-0f08-4a4f-ae52-efe4d2735264" (UID: "93f67bcb-0f08-4a4f-ae52-efe4d2735264"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:45:23.949649 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.949612 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93f67bcb-0f08-4a4f-ae52-efe4d2735264-image-registry-private-configuration\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:45:23.949649 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.949646 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-bound-sa-token\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:45:23.949649 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.949656 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93f67bcb-0f08-4a4f-ae52-efe4d2735264-installation-pull-secrets\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:45:23.949922 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.949665 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-certificates\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:45:23.949922 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.949675 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-registry-tls\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:45:23.949922 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.949683 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72qb4\" (UniqueName: \"kubernetes.io/projected/93f67bcb-0f08-4a4f-ae52-efe4d2735264-kube-api-access-72qb4\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:45:23.949922 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.949691 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93f67bcb-0f08-4a4f-ae52-efe4d2735264-ca-trust-extracted\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:45:23.949922 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:23.949699 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93f67bcb-0f08-4a4f-ae52-efe4d2735264-trusted-ca\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:45:24.065831 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:24.065793 2579 generic.go:356] "Generic (PLEG): container finished" podID="93f67bcb-0f08-4a4f-ae52-efe4d2735264" containerID="8be8bf345c09a2b3662439e3413b845bd4db465b0bf4291ad9ab77d85f6df3f2" exitCode=0 Jul 06 20:45:24.065831 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:24.065833 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-687fcd985d-h48tz" Jul 06 20:45:24.066020 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:24.065855 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-687fcd985d-h48tz" event={"ID":"93f67bcb-0f08-4a4f-ae52-efe4d2735264","Type":"ContainerDied","Data":"8be8bf345c09a2b3662439e3413b845bd4db465b0bf4291ad9ab77d85f6df3f2"} Jul 06 20:45:24.066020 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:24.065905 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-687fcd985d-h48tz" event={"ID":"93f67bcb-0f08-4a4f-ae52-efe4d2735264","Type":"ContainerDied","Data":"093cb3ff66b460cc1aa5438816a9c9a72d98fb13b19d8792c28d4de2e1a67009"} Jul 06 20:45:24.066020 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:24.065928 2579 scope.go:117] "RemoveContainer" containerID="8be8bf345c09a2b3662439e3413b845bd4db465b0bf4291ad9ab77d85f6df3f2" Jul 06 20:45:24.074415 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:24.074396 2579 scope.go:117] "RemoveContainer" containerID="8be8bf345c09a2b3662439e3413b845bd4db465b0bf4291ad9ab77d85f6df3f2" Jul 06 20:45:24.074664 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:45:24.074644 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8be8bf345c09a2b3662439e3413b845bd4db465b0bf4291ad9ab77d85f6df3f2\": container with ID starting with 8be8bf345c09a2b3662439e3413b845bd4db465b0bf4291ad9ab77d85f6df3f2 not found: ID does not exist" containerID="8be8bf345c09a2b3662439e3413b845bd4db465b0bf4291ad9ab77d85f6df3f2" Jul 06 20:45:24.074710 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:24.074672 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8be8bf345c09a2b3662439e3413b845bd4db465b0bf4291ad9ab77d85f6df3f2"} err="failed to get container status \"8be8bf345c09a2b3662439e3413b845bd4db465b0bf4291ad9ab77d85f6df3f2\": rpc error: code = NotFound desc = could not find container \"8be8bf345c09a2b3662439e3413b845bd4db465b0bf4291ad9ab77d85f6df3f2\": container with ID starting with 8be8bf345c09a2b3662439e3413b845bd4db465b0bf4291ad9ab77d85f6df3f2 not found: ID does not exist" Jul 06 20:45:24.102820 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:24.102739 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-687fcd985d-h48tz"] Jul 06 20:45:24.107659 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:24.107633 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-687fcd985d-h48tz"] Jul 06 20:45:25.425062 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:25.425022 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93f67bcb-0f08-4a4f-ae52-efe4d2735264" path="/var/lib/kubelet/pods/93f67bcb-0f08-4a4f-ae52-efe4d2735264/volumes" Jul 06 20:45:27.079829 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:27.079801 2579 generic.go:356] "Generic (PLEG): container finished" podID="fba31ca8-9ebf-4356-bf12-c6478544ca0d" containerID="6cd317d08ccb188bb39e2a8dc3ca48c79ac2e4d8e5d4c132a0cbfdc85066963f" exitCode=0 Jul 06 20:45:27.080235 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:27.079862 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5" event={"ID":"fba31ca8-9ebf-4356-bf12-c6478544ca0d","Type":"ContainerDied","Data":"6cd317d08ccb188bb39e2a8dc3ca48c79ac2e4d8e5d4c132a0cbfdc85066963f"} Jul 06 20:45:27.080274 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:27.080232 2579 scope.go:117] "RemoveContainer" containerID="6cd317d08ccb188bb39e2a8dc3ca48c79ac2e4d8e5d4c132a0cbfdc85066963f" Jul 06 20:45:28.086331 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:28.086294 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-r77q5" event={"ID":"fba31ca8-9ebf-4356-bf12-c6478544ca0d","Type":"ContainerStarted","Data":"e99ec57058b0779e6d6cd9e4dab93e7db28b6d6e279183ce1817968cd895d6c1"} Jul 06 20:45:52.987743 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:52.987653 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:45:53.007162 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:53.007131 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:45:53.208639 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:45:53.208612 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:06.747425 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:06.747393 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:46:06.747915 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:06.747735 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="alertmanager" containerID="cri-o://bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a" gracePeriod=120 Jul 06 20:46:06.747915 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:06.747793 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="kube-rbac-proxy-metric" containerID="cri-o://c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f" gracePeriod=120 Jul 06 20:46:06.747915 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:06.747855 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="prom-label-proxy" containerID="cri-o://4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089" gracePeriod=120 Jul 06 20:46:06.747915 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:06.747835 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="config-reloader" containerID="cri-o://7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26" gracePeriod=120 Jul 06 20:46:06.747915 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:06.747793 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="kube-rbac-proxy-web" containerID="cri-o://7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819" gracePeriod=120 Jul 06 20:46:06.748195 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:06.747836 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="kube-rbac-proxy" containerID="cri-o://016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7" gracePeriod=120 Jul 06 20:46:07.251623 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:07.251592 2579 generic.go:356] "Generic (PLEG): container finished" podID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerID="4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089" exitCode=0 Jul 06 20:46:07.251623 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:07.251617 2579 generic.go:356] "Generic (PLEG): container finished" podID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerID="016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7" exitCode=0 Jul 06 20:46:07.251623 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:07.251623 2579 generic.go:356] "Generic (PLEG): container finished" podID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerID="7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26" exitCode=0 Jul 06 20:46:07.251623 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:07.251629 2579 generic.go:356] "Generic (PLEG): container finished" podID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerID="bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a" exitCode=0 Jul 06 20:46:07.251944 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:07.251667 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecac5f3a-6202-4f38-a57d-301b665f4045","Type":"ContainerDied","Data":"4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089"} Jul 06 20:46:07.251944 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:07.251751 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecac5f3a-6202-4f38-a57d-301b665f4045","Type":"ContainerDied","Data":"016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7"} Jul 06 20:46:07.251944 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:07.251791 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecac5f3a-6202-4f38-a57d-301b665f4045","Type":"ContainerDied","Data":"7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26"} Jul 06 20:46:07.251944 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:07.251826 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecac5f3a-6202-4f38-a57d-301b665f4045","Type":"ContainerDied","Data":"bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a"} Jul 06 20:46:07.998884 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:07.998854 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.095188 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.095161 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-main-tls\") pod \"ecac5f3a-6202-4f38-a57d-301b665f4045\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " Jul 06 20:46:08.095378 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.095200 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ecac5f3a-6202-4f38-a57d-301b665f4045\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " Jul 06 20:46:08.095378 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.095224 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy\") pod \"ecac5f3a-6202-4f38-a57d-301b665f4045\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " Jul 06 20:46:08.095378 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.095252 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecac5f3a-6202-4f38-a57d-301b665f4045-alertmanager-trusted-ca-bundle\") pod \"ecac5f3a-6202-4f38-a57d-301b665f4045\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " Jul 06 20:46:08.095532 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.095387 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-config-volume\") pod \"ecac5f3a-6202-4f38-a57d-301b665f4045\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " Jul 06 20:46:08.095532 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.095442 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4prf2\" (UniqueName: \"kubernetes.io/projected/ecac5f3a-6202-4f38-a57d-301b665f4045-kube-api-access-4prf2\") pod \"ecac5f3a-6202-4f38-a57d-301b665f4045\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " Jul 06 20:46:08.095532 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.095486 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ecac5f3a-6202-4f38-a57d-301b665f4045-config-out\") pod \"ecac5f3a-6202-4f38-a57d-301b665f4045\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " Jul 06 20:46:08.095532 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.095521 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ecac5f3a-6202-4f38-a57d-301b665f4045-alertmanager-main-db\") pod \"ecac5f3a-6202-4f38-a57d-301b665f4045\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " Jul 06 20:46:08.095736 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.095552 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-web-config\") pod \"ecac5f3a-6202-4f38-a57d-301b665f4045\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " Jul 06 20:46:08.095736 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.095584 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy-web\") pod \"ecac5f3a-6202-4f38-a57d-301b665f4045\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " Jul 06 20:46:08.095736 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.095666 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecac5f3a-6202-4f38-a57d-301b665f4045-metrics-client-ca\") pod \"ecac5f3a-6202-4f38-a57d-301b665f4045\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " Jul 06 20:46:08.095736 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.095668 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecac5f3a-6202-4f38-a57d-301b665f4045-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ecac5f3a-6202-4f38-a57d-301b665f4045" (UID: "ecac5f3a-6202-4f38-a57d-301b665f4045"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:46:08.095736 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.095698 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-cluster-tls-config\") pod \"ecac5f3a-6202-4f38-a57d-301b665f4045\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " Jul 06 20:46:08.095736 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.095735 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ecac5f3a-6202-4f38-a57d-301b665f4045-tls-assets\") pod \"ecac5f3a-6202-4f38-a57d-301b665f4045\" (UID: \"ecac5f3a-6202-4f38-a57d-301b665f4045\") " Jul 06 20:46:08.096023 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.095987 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecac5f3a-6202-4f38-a57d-301b665f4045-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:08.096522 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.096490 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecac5f3a-6202-4f38-a57d-301b665f4045-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ecac5f3a-6202-4f38-a57d-301b665f4045" (UID: "ecac5f3a-6202-4f38-a57d-301b665f4045"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:46:08.096654 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.096628 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecac5f3a-6202-4f38-a57d-301b665f4045-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ecac5f3a-6202-4f38-a57d-301b665f4045" (UID: "ecac5f3a-6202-4f38-a57d-301b665f4045"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:46:08.098309 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.098267 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-config-volume" (OuterVolumeSpecName: "config-volume") pod "ecac5f3a-6202-4f38-a57d-301b665f4045" (UID: "ecac5f3a-6202-4f38-a57d-301b665f4045"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:46:08.098577 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.098546 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ecac5f3a-6202-4f38-a57d-301b665f4045" (UID: "ecac5f3a-6202-4f38-a57d-301b665f4045"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:46:08.098673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.098566 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ecac5f3a-6202-4f38-a57d-301b665f4045" (UID: "ecac5f3a-6202-4f38-a57d-301b665f4045"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:46:08.098673 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.098584 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecac5f3a-6202-4f38-a57d-301b665f4045-kube-api-access-4prf2" (OuterVolumeSpecName: "kube-api-access-4prf2") pod "ecac5f3a-6202-4f38-a57d-301b665f4045" (UID: "ecac5f3a-6202-4f38-a57d-301b665f4045"). InnerVolumeSpecName "kube-api-access-4prf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:46:08.098976 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.098953 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecac5f3a-6202-4f38-a57d-301b665f4045-config-out" (OuterVolumeSpecName: "config-out") pod "ecac5f3a-6202-4f38-a57d-301b665f4045" (UID: "ecac5f3a-6202-4f38-a57d-301b665f4045"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:46:08.099073 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.099027 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ecac5f3a-6202-4f38-a57d-301b665f4045" (UID: "ecac5f3a-6202-4f38-a57d-301b665f4045"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:46:08.099257 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.099233 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecac5f3a-6202-4f38-a57d-301b665f4045-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ecac5f3a-6202-4f38-a57d-301b665f4045" (UID: "ecac5f3a-6202-4f38-a57d-301b665f4045"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:46:08.100109 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.100035 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ecac5f3a-6202-4f38-a57d-301b665f4045" (UID: "ecac5f3a-6202-4f38-a57d-301b665f4045"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:46:08.103270 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.103242 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ecac5f3a-6202-4f38-a57d-301b665f4045" (UID: "ecac5f3a-6202-4f38-a57d-301b665f4045"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:46:08.109266 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.109242 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-web-config" (OuterVolumeSpecName: "web-config") pod "ecac5f3a-6202-4f38-a57d-301b665f4045" (UID: "ecac5f3a-6202-4f38-a57d-301b665f4045"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:46:08.197389 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.197354 2579 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ecac5f3a-6202-4f38-a57d-301b665f4045-metrics-client-ca\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:08.197389 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.197380 2579 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-cluster-tls-config\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:08.197389 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.197390 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ecac5f3a-6202-4f38-a57d-301b665f4045-tls-assets\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:08.197587 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.197402 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-main-tls\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:08.197587 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.197412 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:08.197587 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.197422 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:08.197587 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.197431 2579 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-config-volume\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:08.197587 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.197440 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4prf2\" (UniqueName: \"kubernetes.io/projected/ecac5f3a-6202-4f38-a57d-301b665f4045-kube-api-access-4prf2\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:08.197587 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.197448 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ecac5f3a-6202-4f38-a57d-301b665f4045-config-out\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:08.197587 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.197456 2579 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ecac5f3a-6202-4f38-a57d-301b665f4045-alertmanager-main-db\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:08.197587 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.197465 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-web-config\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:08.197587 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.197473 2579 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ecac5f3a-6202-4f38-a57d-301b665f4045-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:08.258605 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.258569 2579 generic.go:356] "Generic (PLEG): container finished" podID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerID="c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f" exitCode=0 Jul 06 20:46:08.258605 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.258601 2579 generic.go:356] "Generic (PLEG): container finished" podID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerID="7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819" exitCode=0 Jul 06 20:46:08.258853 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.258650 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.258853 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.258653 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecac5f3a-6202-4f38-a57d-301b665f4045","Type":"ContainerDied","Data":"c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f"} Jul 06 20:46:08.258853 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.258747 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecac5f3a-6202-4f38-a57d-301b665f4045","Type":"ContainerDied","Data":"7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819"} Jul 06 20:46:08.258853 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.258794 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ecac5f3a-6202-4f38-a57d-301b665f4045","Type":"ContainerDied","Data":"f5e10aeeceb56bb0fb1f5b85f2783c07ede442d6c371badb0ccfe5d72ac0ef1a"} Jul 06 20:46:08.258853 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.258811 2579 scope.go:117] "RemoveContainer" containerID="4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089" Jul 06 20:46:08.267253 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.267234 2579 scope.go:117] "RemoveContainer" containerID="c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f" Jul 06 20:46:08.274537 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.274514 2579 scope.go:117] "RemoveContainer" containerID="016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7" Jul 06 20:46:08.281665 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.281648 2579 scope.go:117] "RemoveContainer" containerID="7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819" Jul 06 20:46:08.285640 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.285619 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:46:08.290018 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.289996 2579 scope.go:117] "RemoveContainer" containerID="7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26" Jul 06 20:46:08.290745 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.290721 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:46:08.297147 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.297127 2579 scope.go:117] "RemoveContainer" containerID="bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a" Jul 06 20:46:08.304423 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.304402 2579 scope.go:117] "RemoveContainer" containerID="6c81f7c7bd7adae30ee7331da16646bada2f02051aed9a09632c8572edd88433" Jul 06 20:46:08.313369 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.313349 2579 scope.go:117] "RemoveContainer" containerID="4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089" Jul 06 20:46:08.313849 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:46:08.313826 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089\": container with ID starting with 4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089 not found: ID does not exist" containerID="4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089" Jul 06 20:46:08.313919 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.313859 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089"} err="failed to get container status \"4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089\": rpc error: code = NotFound desc = could not find container \"4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089\": container with ID starting with 4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089 not found: ID does not exist" Jul 06 20:46:08.313919 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.313877 2579 scope.go:117] "RemoveContainer" containerID="c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f" Jul 06 20:46:08.314175 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:46:08.314157 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f\": container with ID starting with c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f not found: ID does not exist" containerID="c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f" Jul 06 20:46:08.314219 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.314180 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f"} err="failed to get container status \"c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f\": rpc error: code = NotFound desc = could not find container \"c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f\": container with ID starting with c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f not found: ID does not exist" Jul 06 20:46:08.314219 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.314194 2579 scope.go:117] "RemoveContainer" containerID="016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7" Jul 06 20:46:08.314464 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:46:08.314446 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7\": container with ID starting with 016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7 not found: ID does not exist" containerID="016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7" Jul 06 20:46:08.314533 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.314487 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7"} err="failed to get container status \"016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7\": rpc error: code = NotFound desc = could not find container \"016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7\": container with ID starting with 016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7 not found: ID does not exist" Jul 06 20:46:08.314533 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.314513 2579 scope.go:117] "RemoveContainer" containerID="7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819" Jul 06 20:46:08.314749 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:46:08.314726 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819\": container with ID starting with 7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819 not found: ID does not exist" containerID="7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819" Jul 06 20:46:08.314791 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.314757 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819"} err="failed to get container status \"7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819\": rpc error: code = NotFound desc = could not find container \"7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819\": container with ID starting with 7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819 not found: ID does not exist" Jul 06 20:46:08.314791 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.314773 2579 scope.go:117] "RemoveContainer" containerID="7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26" Jul 06 20:46:08.315007 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:46:08.314991 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26\": container with ID starting with 7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26 not found: ID does not exist" containerID="7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26" Jul 06 20:46:08.315078 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.315014 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26"} err="failed to get container status \"7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26\": rpc error: code = NotFound desc = could not find container \"7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26\": container with ID starting with 7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26 not found: ID does not exist" Jul 06 20:46:08.315078 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.315035 2579 scope.go:117] "RemoveContainer" containerID="bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a" Jul 06 20:46:08.315306 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:46:08.315290 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a\": container with ID starting with bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a not found: ID does not exist" containerID="bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a" Jul 06 20:46:08.315352 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.315310 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a"} err="failed to get container status \"bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a\": rpc error: code = NotFound desc = could not find container \"bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a\": container with ID starting with bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a not found: ID does not exist" Jul 06 20:46:08.315352 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.315324 2579 scope.go:117] "RemoveContainer" containerID="6c81f7c7bd7adae30ee7331da16646bada2f02051aed9a09632c8572edd88433" Jul 06 20:46:08.315501 ip-10-0-134-228 kubenswrapper[2579]: E0706 20:46:08.315488 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c81f7c7bd7adae30ee7331da16646bada2f02051aed9a09632c8572edd88433\": container with ID starting with 6c81f7c7bd7adae30ee7331da16646bada2f02051aed9a09632c8572edd88433 not found: ID does not exist" containerID="6c81f7c7bd7adae30ee7331da16646bada2f02051aed9a09632c8572edd88433" Jul 06 20:46:08.315542 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.315504 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c81f7c7bd7adae30ee7331da16646bada2f02051aed9a09632c8572edd88433"} err="failed to get container status \"6c81f7c7bd7adae30ee7331da16646bada2f02051aed9a09632c8572edd88433\": rpc error: code = NotFound desc = could not find container \"6c81f7c7bd7adae30ee7331da16646bada2f02051aed9a09632c8572edd88433\": container with ID starting with 6c81f7c7bd7adae30ee7331da16646bada2f02051aed9a09632c8572edd88433 not found: ID does not exist" Jul 06 20:46:08.315542 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.315516 2579 scope.go:117] "RemoveContainer" containerID="4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089" Jul 06 20:46:08.315734 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.315710 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089"} err="failed to get container status \"4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089\": rpc error: code = NotFound desc = could not find container \"4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089\": container with ID starting with 4c0638698d4c7caadfc31b089019824a1a6a25006036a496d5e599519f058089 not found: ID does not exist" Jul 06 20:46:08.315734 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.315731 2579 scope.go:117] "RemoveContainer" containerID="c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f" Jul 06 20:46:08.315925 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.315909 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f"} err="failed to get container status \"c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f\": rpc error: code = NotFound desc = could not find container \"c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f\": container with ID starting with c670d8beaf502798620ae4c29403d08d8ff602f3e02515bec09fbdeeda34580f not found: ID does not exist" Jul 06 20:46:08.315974 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.315926 2579 scope.go:117] "RemoveContainer" containerID="016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7" Jul 06 20:46:08.316117 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.316100 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7"} err="failed to get container status \"016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7\": rpc error: code = NotFound desc = could not find container \"016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7\": container with ID starting with 016499c52f02cba2d102b0f8774e77dd721a9630852480dfc32ba90044e837f7 not found: ID does not exist" Jul 06 20:46:08.316160 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.316118 2579 scope.go:117] "RemoveContainer" containerID="7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819" Jul 06 20:46:08.316302 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.316270 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819"} err="failed to get container status \"7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819\": rpc error: code = NotFound desc = could not find container \"7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819\": container with ID starting with 7aaf7b4279aab186d17eb1fe3ce2186a832e1e75b698ee34b10e7396fd5a8819 not found: ID does not exist" Jul 06 20:46:08.316353 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.316304 2579 scope.go:117] "RemoveContainer" containerID="7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26" Jul 06 20:46:08.316534 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.316514 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26"} err="failed to get container status \"7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26\": rpc error: code = NotFound desc = could not find container \"7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26\": container with ID starting with 7cec6fd45a44af5a066af90031fd306a24adc8da53bbe1f52b70b8c78884eb26 not found: ID does not exist" Jul 06 20:46:08.316607 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.316535 2579 scope.go:117] "RemoveContainer" containerID="bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a" Jul 06 20:46:08.316743 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.316726 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a"} err="failed to get container status \"bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a\": rpc error: code = NotFound desc = could not find container \"bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a\": container with ID starting with bf5846ecc51652158a8994e882377280accb4467e4762bdeb2e7bc69827a657a not found: ID does not exist" Jul 06 20:46:08.316784 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.316744 2579 scope.go:117] "RemoveContainer" containerID="6c81f7c7bd7adae30ee7331da16646bada2f02051aed9a09632c8572edd88433" Jul 06 20:46:08.316894 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.316877 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c81f7c7bd7adae30ee7331da16646bada2f02051aed9a09632c8572edd88433"} err="failed to get container status \"6c81f7c7bd7adae30ee7331da16646bada2f02051aed9a09632c8572edd88433\": rpc error: code = NotFound desc = could not find container \"6c81f7c7bd7adae30ee7331da16646bada2f02051aed9a09632c8572edd88433\": container with ID starting with 6c81f7c7bd7adae30ee7331da16646bada2f02051aed9a09632c8572edd88433 not found: ID does not exist" Jul 06 20:46:08.323445 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323419 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:46:08.323700 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323689 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="kube-rbac-proxy-metric" Jul 06 20:46:08.323741 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323702 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="kube-rbac-proxy-metric" Jul 06 20:46:08.323741 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323716 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="kube-rbac-proxy" Jul 06 20:46:08.323741 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323722 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="kube-rbac-proxy" Jul 06 20:46:08.323741 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323729 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="config-reloader" Jul 06 20:46:08.323741 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323734 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="config-reloader" Jul 06 20:46:08.323741 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323740 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="init-config-reloader" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323746 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="init-config-reloader" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323752 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="alertmanager" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323757 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="alertmanager" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323764 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="prom-label-proxy" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323769 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="prom-label-proxy" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323778 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93f67bcb-0f08-4a4f-ae52-efe4d2735264" containerName="registry" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323783 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="93f67bcb-0f08-4a4f-ae52-efe4d2735264" containerName="registry" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323792 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="kube-rbac-proxy-web" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323798 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="kube-rbac-proxy-web" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323804 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c1555f0-3134-47b0-a95d-c92e215651ba" containerName="console" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323810 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c1555f0-3134-47b0-a95d-c92e215651ba" containerName="console" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323853 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="93f67bcb-0f08-4a4f-ae52-efe4d2735264" containerName="registry" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323862 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c1555f0-3134-47b0-a95d-c92e215651ba" containerName="console" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323868 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="alertmanager" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323873 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="prom-label-proxy" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323878 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="kube-rbac-proxy-metric" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323883 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="kube-rbac-proxy-web" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323888 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="kube-rbac-proxy" Jul 06 20:46:08.323913 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.323893 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" containerName="config-reloader" Jul 06 20:46:08.330740 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.330718 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.334460 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.334441 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 20:46:08.334576 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.334443 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 20:46:08.335263 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.335247 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 20:46:08.335557 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.335536 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 20:46:08.335835 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.335813 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 20:46:08.335909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.335890 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 20:46:08.336124 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.336104 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 20:46:08.336257 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.336223 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 20:46:08.336357 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.336340 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5bjtg\"" Jul 06 20:46:08.343019 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.342997 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:46:08.343395 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.343377 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 20:46:08.399185 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.399096 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99a8c366-396f-4f6a-a4c7-813bc310b098-config-out\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.399185 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.399137 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.399185 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.399158 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9xb6\" (UniqueName: \"kubernetes.io/projected/99a8c366-396f-4f6a-a4c7-813bc310b098-kube-api-access-n9xb6\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.399397 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.399241 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99a8c366-396f-4f6a-a4c7-813bc310b098-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.399397 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.399292 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-config-volume\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.399397 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.399330 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.399397 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.399362 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.399397 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.399376 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-web-config\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.399542 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.399406 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99a8c366-396f-4f6a-a4c7-813bc310b098-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.399542 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.399423 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99a8c366-396f-4f6a-a4c7-813bc310b098-tls-assets\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.399542 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.399464 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.399542 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.399490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.399542 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.399519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/99a8c366-396f-4f6a-a4c7-813bc310b098-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.500205 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.500150 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-config-volume\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.500205 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.500221 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.500389 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.500242 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.500389 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.500260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-web-config\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.500389 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.500319 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99a8c366-396f-4f6a-a4c7-813bc310b098-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.500389 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.500346 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99a8c366-396f-4f6a-a4c7-813bc310b098-tls-assets\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.500389 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.500373 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.500666 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.500418 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.500666 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.500443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/99a8c366-396f-4f6a-a4c7-813bc310b098-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.500666 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.500483 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99a8c366-396f-4f6a-a4c7-813bc310b098-config-out\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.500666 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.500519 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.500666 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.500546 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9xb6\" (UniqueName: \"kubernetes.io/projected/99a8c366-396f-4f6a-a4c7-813bc310b098-kube-api-access-n9xb6\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.500666 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.500618 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99a8c366-396f-4f6a-a4c7-813bc310b098-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.501880 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.501315 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/99a8c366-396f-4f6a-a4c7-813bc310b098-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.503899 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.503396 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/99a8c366-396f-4f6a-a4c7-813bc310b098-tls-assets\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.503899 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.503525 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.503899 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.503541 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.503899 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.503602 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-web-config\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.503899 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.503679 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-config-volume\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.503899 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.503689 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.503899 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.503794 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.504274 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.504110 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/99a8c366-396f-4f6a-a4c7-813bc310b098-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.504274 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.504157 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/99a8c366-396f-4f6a-a4c7-813bc310b098-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.504274 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.504160 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/99a8c366-396f-4f6a-a4c7-813bc310b098-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.505461 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.505442 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/99a8c366-396f-4f6a-a4c7-813bc310b098-config-out\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.513347 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.513323 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9xb6\" (UniqueName: \"kubernetes.io/projected/99a8c366-396f-4f6a-a4c7-813bc310b098-kube-api-access-n9xb6\") pod \"alertmanager-main-0\" (UID: \"99a8c366-396f-4f6a-a4c7-813bc310b098\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.642432 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.642398 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 20:46:08.782253 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:08.782227 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 20:46:08.784599 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:46:08.784567 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a8c366_396f_4f6a_a4c7_813bc310b098.slice/crio-1ba0274e181e48fa8788772e085c906b57753b2bc7fe68f81095244e8093232a WatchSource:0}: Error finding container 1ba0274e181e48fa8788772e085c906b57753b2bc7fe68f81095244e8093232a: Status 404 returned error can't find the container with id 1ba0274e181e48fa8788772e085c906b57753b2bc7fe68f81095244e8093232a Jul 06 20:46:09.264190 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:09.264149 2579 generic.go:356] "Generic (PLEG): container finished" podID="99a8c366-396f-4f6a-a4c7-813bc310b098" containerID="8b716a31262c52df4c00970106a1cbff551bc20a9bf99fa3c38dc3a91b6b718e" exitCode=0 Jul 06 20:46:09.264637 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:09.264244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99a8c366-396f-4f6a-a4c7-813bc310b098","Type":"ContainerDied","Data":"8b716a31262c52df4c00970106a1cbff551bc20a9bf99fa3c38dc3a91b6b718e"} Jul 06 20:46:09.264637 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:09.264331 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99a8c366-396f-4f6a-a4c7-813bc310b098","Type":"ContainerStarted","Data":"1ba0274e181e48fa8788772e085c906b57753b2bc7fe68f81095244e8093232a"} Jul 06 20:46:09.425796 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:09.425763 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecac5f3a-6202-4f38-a57d-301b665f4045" path="/var/lib/kubelet/pods/ecac5f3a-6202-4f38-a57d-301b665f4045/volumes" Jul 06 20:46:10.278257 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.278220 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99a8c366-396f-4f6a-a4c7-813bc310b098","Type":"ContainerStarted","Data":"bbc97cee5b4e1cca477d197d6741b13d433b9187e604a28f6ab9a569f6b45a84"} Jul 06 20:46:10.278643 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.278305 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99a8c366-396f-4f6a-a4c7-813bc310b098","Type":"ContainerStarted","Data":"2ce9cd4892d165c7e0c3d49713e011d1fd0982346e77263ca242cd7f728466f3"} Jul 06 20:46:10.278643 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.278332 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99a8c366-396f-4f6a-a4c7-813bc310b098","Type":"ContainerStarted","Data":"a8fc3dfccc1fb624e583f514de20c10ab0d1fe016576aa8da52a0fcb9bbe6e3c"} Jul 06 20:46:10.278643 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.278357 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99a8c366-396f-4f6a-a4c7-813bc310b098","Type":"ContainerStarted","Data":"83af00ea7763c60bfaef9dd4f554bbf5236f039628171b0066665acc8d1ab3e9"} Jul 06 20:46:10.278643 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.278381 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99a8c366-396f-4f6a-a4c7-813bc310b098","Type":"ContainerStarted","Data":"b5020514df25ef6e90eb79cd9fe6182b0a63eda1cc62d049097f88b5da23cbd8"} Jul 06 20:46:10.278643 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.278402 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"99a8c366-396f-4f6a-a4c7-813bc310b098","Type":"ContainerStarted","Data":"8fdf8e4b8cb287c552b296deb2f43ee6f211d7f24ee4ef688c8d0430af7691d8"} Jul 06 20:46:10.311386 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.311319 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.296302133 podStartE2EDuration="2.311298149s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.996016ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:46:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:46:10.309513911 +0000 UTC m=+194.398018974" watchObservedRunningTime="2026-07-06 20:46:10.311298149 +0000 UTC m=+194.399803186" Jul 06 20:46:10.767245 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.767211 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-56645f9db4-bbh4z"] Jul 06 20:46:10.769575 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.769557 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.772176 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.772149 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 20:46:10.772341 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.772176 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 20:46:10.772646 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.772624 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 20:46:10.772646 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.772653 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2nczj\"" Jul 06 20:46:10.772808 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.772624 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 20:46:10.772808 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.772800 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 20:46:10.778999 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.778976 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 20:46:10.781849 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.781819 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56645f9db4-bbh4z"] Jul 06 20:46:10.823715 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.823681 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17a1dd23-8672-4551-a6d2-67b974c95715-metrics-client-ca\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.823869 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.823734 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/17a1dd23-8672-4551-a6d2-67b974c95715-federate-client-tls\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.823869 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.823807 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jc5s\" (UniqueName: \"kubernetes.io/projected/17a1dd23-8672-4551-a6d2-67b974c95715-kube-api-access-4jc5s\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.823869 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.823842 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17a1dd23-8672-4551-a6d2-67b974c95715-serving-certs-ca-bundle\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.824014 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.823898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17a1dd23-8672-4551-a6d2-67b974c95715-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.824014 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.823926 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/17a1dd23-8672-4551-a6d2-67b974c95715-secret-telemeter-client\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.824014 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.823956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/17a1dd23-8672-4551-a6d2-67b974c95715-telemeter-client-tls\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.824014 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.823977 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17a1dd23-8672-4551-a6d2-67b974c95715-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.924502 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.924460 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jc5s\" (UniqueName: \"kubernetes.io/projected/17a1dd23-8672-4551-a6d2-67b974c95715-kube-api-access-4jc5s\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.924502 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.924509 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17a1dd23-8672-4551-a6d2-67b974c95715-serving-certs-ca-bundle\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.924770 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.924545 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17a1dd23-8672-4551-a6d2-67b974c95715-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.924770 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.924584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/17a1dd23-8672-4551-a6d2-67b974c95715-secret-telemeter-client\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.924770 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.924624 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/17a1dd23-8672-4551-a6d2-67b974c95715-telemeter-client-tls\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.924770 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.924648 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17a1dd23-8672-4551-a6d2-67b974c95715-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.924770 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.924693 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17a1dd23-8672-4551-a6d2-67b974c95715-metrics-client-ca\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.924770 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.924752 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/17a1dd23-8672-4551-a6d2-67b974c95715-federate-client-tls\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.925449 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.925417 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17a1dd23-8672-4551-a6d2-67b974c95715-serving-certs-ca-bundle\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.925736 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.925704 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17a1dd23-8672-4551-a6d2-67b974c95715-metrics-client-ca\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.925841 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.925757 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17a1dd23-8672-4551-a6d2-67b974c95715-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.927707 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.927682 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17a1dd23-8672-4551-a6d2-67b974c95715-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.927824 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.927682 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/17a1dd23-8672-4551-a6d2-67b974c95715-federate-client-tls\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.927886 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.927835 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/17a1dd23-8672-4551-a6d2-67b974c95715-telemeter-client-tls\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.927886 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.927835 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/17a1dd23-8672-4551-a6d2-67b974c95715-secret-telemeter-client\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:10.934973 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:10.934941 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jc5s\" (UniqueName: \"kubernetes.io/projected/17a1dd23-8672-4551-a6d2-67b974c95715-kube-api-access-4jc5s\") pod \"telemeter-client-56645f9db4-bbh4z\" (UID: \"17a1dd23-8672-4551-a6d2-67b974c95715\") " pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:11.076579 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.076490 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:46:11.077108 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.076874 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1ddee0ded363773c9a6884dbfe31319e74a761404934d5e1d01bf50b3ec99801" gracePeriod=600 Jul 06 20:46:11.077108 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.076901 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="thanos-sidecar" containerID="cri-o://59aad0f7fd5981641d523e976ded4a99ad134a7cb2b58bc5895e56744d8931db" gracePeriod=600 Jul 06 20:46:11.077108 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.076929 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="kube-rbac-proxy" containerID="cri-o://342bd8819d84c96a1bed67c10933fe6e343be3846adb20e49ff7fe5f4f936491" gracePeriod=600 Jul 06 20:46:11.077108 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.076870 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="prometheus" containerID="cri-o://df9fcbeb3ccd869261f2e39e0dd74adb6121c0329d41b11ae11612dd445eaf4a" gracePeriod=600 Jul 06 20:46:11.077108 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.076895 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="kube-rbac-proxy-web" containerID="cri-o://e4da94f4b9fd39d9f5392f8d559ee8837021b81a5b22ad81c89a46d8358456eb" gracePeriod=600 Jul 06 20:46:11.077449 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.077101 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="config-reloader" containerID="cri-o://a2681f6c69241bf3c6fead7b3f403015a39d5dbcb5b214f37f7187ff3625af77" gracePeriod=600 Jul 06 20:46:11.086471 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.086269 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" Jul 06 20:46:11.254283 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.254256 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56645f9db4-bbh4z"] Jul 06 20:46:11.256683 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:46:11.256650 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17a1dd23_8672_4551_a6d2_67b974c95715.slice/crio-ff4bd3c767cc265e9bf4c0bc63c448a0115eb62232a22219622532a56e99ab10 WatchSource:0}: Error finding container ff4bd3c767cc265e9bf4c0bc63c448a0115eb62232a22219622532a56e99ab10: Status 404 returned error can't find the container with id ff4bd3c767cc265e9bf4c0bc63c448a0115eb62232a22219622532a56e99ab10 Jul 06 20:46:11.285622 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.285517 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" event={"ID":"17a1dd23-8672-4551-a6d2-67b974c95715","Type":"ContainerStarted","Data":"ff4bd3c767cc265e9bf4c0bc63c448a0115eb62232a22219622532a56e99ab10"} Jul 06 20:46:11.290577 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.290512 2579 generic.go:356] "Generic (PLEG): container finished" podID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerID="1ddee0ded363773c9a6884dbfe31319e74a761404934d5e1d01bf50b3ec99801" exitCode=0 Jul 06 20:46:11.290577 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.290558 2579 generic.go:356] "Generic (PLEG): container finished" podID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerID="342bd8819d84c96a1bed67c10933fe6e343be3846adb20e49ff7fe5f4f936491" exitCode=0 Jul 06 20:46:11.290577 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.290570 2579 generic.go:356] "Generic (PLEG): container finished" podID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerID="e4da94f4b9fd39d9f5392f8d559ee8837021b81a5b22ad81c89a46d8358456eb" exitCode=0 Jul 06 20:46:11.290577 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.290581 2579 generic.go:356] "Generic (PLEG): container finished" podID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerID="59aad0f7fd5981641d523e976ded4a99ad134a7cb2b58bc5895e56744d8931db" exitCode=0 Jul 06 20:46:11.290876 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.290591 2579 generic.go:356] "Generic (PLEG): container finished" podID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerID="a2681f6c69241bf3c6fead7b3f403015a39d5dbcb5b214f37f7187ff3625af77" exitCode=0 Jul 06 20:46:11.290876 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.290599 2579 generic.go:356] "Generic (PLEG): container finished" podID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerID="df9fcbeb3ccd869261f2e39e0dd74adb6121c0329d41b11ae11612dd445eaf4a" exitCode=0 Jul 06 20:46:11.290876 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.290619 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dd4fd7e-236a-48f4-80dd-17a05f8298af","Type":"ContainerDied","Data":"1ddee0ded363773c9a6884dbfe31319e74a761404934d5e1d01bf50b3ec99801"} Jul 06 20:46:11.290876 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.290705 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dd4fd7e-236a-48f4-80dd-17a05f8298af","Type":"ContainerDied","Data":"342bd8819d84c96a1bed67c10933fe6e343be3846adb20e49ff7fe5f4f936491"} Jul 06 20:46:11.290876 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.290742 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dd4fd7e-236a-48f4-80dd-17a05f8298af","Type":"ContainerDied","Data":"e4da94f4b9fd39d9f5392f8d559ee8837021b81a5b22ad81c89a46d8358456eb"} Jul 06 20:46:11.290876 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.290781 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dd4fd7e-236a-48f4-80dd-17a05f8298af","Type":"ContainerDied","Data":"59aad0f7fd5981641d523e976ded4a99ad134a7cb2b58bc5895e56744d8931db"} Jul 06 20:46:11.290876 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.290819 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dd4fd7e-236a-48f4-80dd-17a05f8298af","Type":"ContainerDied","Data":"a2681f6c69241bf3c6fead7b3f403015a39d5dbcb5b214f37f7187ff3625af77"} Jul 06 20:46:11.290876 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.290857 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dd4fd7e-236a-48f4-80dd-17a05f8298af","Type":"ContainerDied","Data":"df9fcbeb3ccd869261f2e39e0dd74adb6121c0329d41b11ae11612dd445eaf4a"} Jul 06 20:46:11.333965 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.333661 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:11.430644 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.430612 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-trusted-ca-bundle\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.430800 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.430668 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-grpc-tls\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.430800 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.430700 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-metrics-client-certs\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.430800 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.430757 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.430800 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.430793 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dd4fd7e-236a-48f4-80dd-17a05f8298af-tls-assets\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.431016 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.430832 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-web-config\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.431016 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.430897 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-thanos-prometheus-http-client-file\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.431016 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.430935 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-0\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.431016 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.430973 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-1\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.431016 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.430971 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:46:11.431016 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.431006 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-serving-certs-ca-bundle\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.431378 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.431064 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-kubelet-serving-ca-bundle\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.431378 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.431095 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-tls\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.431378 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.431121 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-config\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.431378 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.431149 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dd4fd7e-236a-48f4-80dd-17a05f8298af-config-out\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.431378 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.431177 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-kube-rbac-proxy\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.431378 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.431202 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-metrics-client-ca\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.431378 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.431244 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-db\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.431378 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.431279 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.431378 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.431320 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-2\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.431378 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.431362 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj8gz\" (UniqueName: \"kubernetes.io/projected/6dd4fd7e-236a-48f4-80dd-17a05f8298af-kube-api-access-lj8gz\") pod \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\" (UID: \"6dd4fd7e-236a-48f4-80dd-17a05f8298af\") " Jul 06 20:46:11.431845 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.431413 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:46:11.431845 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.431431 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:46:11.431845 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.431792 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:46:11.432273 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.432249 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.432436 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.432387 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:46:11.432915 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.432894 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.433122 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.433091 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:46:11.434216 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.434198 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.434458 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.434438 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dd4fd7e-236a-48f4-80dd-17a05f8298af-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:46:11.434762 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.434700 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:46:11.434857 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.434717 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:46:11.434945 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.434804 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:46:11.435148 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.435104 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:46:11.435318 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.435274 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:46:11.435754 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.435729 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:46:11.436205 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.436172 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6dd4fd7e-236a-48f4-80dd-17a05f8298af-config-out" (OuterVolumeSpecName: "config-out") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:46:11.437090 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.437034 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:46:11.437278 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.437247 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:46:11.437359 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.437288 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:46:11.437558 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.437538 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-config" (OuterVolumeSpecName: "config") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:46:11.438096 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.438074 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dd4fd7e-236a-48f4-80dd-17a05f8298af-kube-api-access-lj8gz" (OuterVolumeSpecName: "kube-api-access-lj8gz") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "kube-api-access-lj8gz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:46:11.446316 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.446291 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-web-config" (OuterVolumeSpecName: "web-config") pod "6dd4fd7e-236a-48f4-80dd-17a05f8298af" (UID: "6dd4fd7e-236a-48f4-80dd-17a05f8298af"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:46:11.535717 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.535672 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-web-config\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.535717 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.535712 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.535717 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.535722 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.535934 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.535731 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.535934 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.535741 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.535934 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.535749 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-config\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.535934 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.535757 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6dd4fd7e-236a-48f4-80dd-17a05f8298af-config-out\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.535934 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.535766 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-kube-rbac-proxy\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.535934 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.535775 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-configmap-metrics-client-ca\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.535934 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.535787 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-db\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.535934 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.535795 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.535934 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.535804 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6dd4fd7e-236a-48f4-80dd-17a05f8298af-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.535934 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.535812 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj8gz\" (UniqueName: \"kubernetes.io/projected/6dd4fd7e-236a-48f4-80dd-17a05f8298af-kube-api-access-lj8gz\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.535934 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.535820 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-grpc-tls\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.535934 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.535828 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-metrics-client-certs\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.535934 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.535838 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6dd4fd7e-236a-48f4-80dd-17a05f8298af-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:11.535934 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:11.535846 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6dd4fd7e-236a-48f4-80dd-17a05f8298af-tls-assets\") on node \"ip-10-0-134-228.ec2.internal\" DevicePath \"\"" Jul 06 20:46:12.298657 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.298571 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.298657 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.298577 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6dd4fd7e-236a-48f4-80dd-17a05f8298af","Type":"ContainerDied","Data":"2b9bc6cd1ab49f3b57fd30beb76a27d2c586f1a12d17a1cfe623874655272cd4"} Jul 06 20:46:12.298657 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.298654 2579 scope.go:117] "RemoveContainer" containerID="1ddee0ded363773c9a6884dbfe31319e74a761404934d5e1d01bf50b3ec99801" Jul 06 20:46:12.307306 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.307119 2579 scope.go:117] "RemoveContainer" containerID="342bd8819d84c96a1bed67c10933fe6e343be3846adb20e49ff7fe5f4f936491" Jul 06 20:46:12.316026 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.316006 2579 scope.go:117] "RemoveContainer" containerID="e4da94f4b9fd39d9f5392f8d559ee8837021b81a5b22ad81c89a46d8358456eb" Jul 06 20:46:12.323083 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.323035 2579 scope.go:117] "RemoveContainer" containerID="59aad0f7fd5981641d523e976ded4a99ad134a7cb2b58bc5895e56744d8931db" Jul 06 20:46:12.325533 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.325507 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:46:12.330944 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.330913 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:46:12.332222 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.332201 2579 scope.go:117] "RemoveContainer" containerID="a2681f6c69241bf3c6fead7b3f403015a39d5dbcb5b214f37f7187ff3625af77" Jul 06 20:46:12.343184 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.343151 2579 scope.go:117] "RemoveContainer" containerID="df9fcbeb3ccd869261f2e39e0dd74adb6121c0329d41b11ae11612dd445eaf4a" Jul 06 20:46:12.352691 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.352668 2579 scope.go:117] "RemoveContainer" containerID="9b561f5cc69f8ed39f613de1ccc9f779b4c2a538f5e1af36de8a2c04d0027451" Jul 06 20:46:12.358471 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.358444 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:46:12.358892 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.358877 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="kube-rbac-proxy-thanos" Jul 06 20:46:12.358951 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.358897 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="kube-rbac-proxy-thanos" Jul 06 20:46:12.358951 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.358913 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="kube-rbac-proxy-web" Jul 06 20:46:12.358951 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.358922 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="kube-rbac-proxy-web" Jul 06 20:46:12.358951 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.358946 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="prometheus" Jul 06 20:46:12.358951 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.358952 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="prometheus" Jul 06 20:46:12.359144 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.358959 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="config-reloader" Jul 06 20:46:12.359144 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.358967 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="config-reloader" Jul 06 20:46:12.359144 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.358981 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="init-config-reloader" Jul 06 20:46:12.359144 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.358987 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="init-config-reloader" Jul 06 20:46:12.359144 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.358993 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="kube-rbac-proxy" Jul 06 20:46:12.359144 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.358998 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="kube-rbac-proxy" Jul 06 20:46:12.359144 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.359005 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="thanos-sidecar" Jul 06 20:46:12.359144 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.359010 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="thanos-sidecar" Jul 06 20:46:12.359144 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.359085 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="kube-rbac-proxy-web" Jul 06 20:46:12.359144 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.359096 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="kube-rbac-proxy-thanos" Jul 06 20:46:12.359144 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.359107 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="kube-rbac-proxy" Jul 06 20:46:12.359144 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.359117 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="config-reloader" Jul 06 20:46:12.359144 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.359126 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="thanos-sidecar" Jul 06 20:46:12.359144 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.359132 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" containerName="prometheus" Jul 06 20:46:12.365474 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.365449 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.368293 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.368250 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 20:46:12.368415 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.368378 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 20:46:12.368551 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.368531 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 20:46:12.368733 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.368691 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 20:46:12.369056 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.368930 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 20:46:12.369056 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.369018 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2rd7r\"" Jul 06 20:46:12.369731 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.369318 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 20:46:12.369731 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.369443 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 20:46:12.369731 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.369500 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4cvlt04bur0sh\"" Jul 06 20:46:12.369731 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.369541 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 20:46:12.369731 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.369606 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 20:46:12.369731 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.369656 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 20:46:12.370111 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.369877 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 20:46:12.370111 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.369978 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 20:46:12.370111 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.369980 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 20:46:12.373838 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.373628 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 20:46:12.376322 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.376303 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 20:46:12.380355 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.380260 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:46:12.442972 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.442941 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.442972 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.442974 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443254 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443002 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443254 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443024 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443254 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443254 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443118 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443254 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443169 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443254 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443197 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443476 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443267 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5h4q\" (UniqueName: \"kubernetes.io/projected/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-kube-api-access-w5h4q\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443476 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443296 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443476 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443313 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-web-config\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443476 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443335 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443476 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443356 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443476 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443384 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443476 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443405 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443476 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443436 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-config-out\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443476 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443458 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443762 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443762 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-config\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.443762 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.443519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.544579 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.544536 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.544750 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.544588 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-config-out\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.544750 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.544670 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.544750 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.544709 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.544750 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.544733 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-config\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.544956 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.544756 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.544956 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.544796 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.544956 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.544823 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.544956 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.544865 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.544956 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.544905 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.544956 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.544928 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.544956 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.544949 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.545327 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.544974 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.545327 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.544996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.545327 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.545037 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5h4q\" (UniqueName: \"kubernetes.io/projected/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-kube-api-access-w5h4q\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.545327 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.545116 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.545327 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.545141 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-web-config\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.545327 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.545183 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.545327 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.545213 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.545327 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.545257 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.546924 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.546235 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.546924 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.546552 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.547111 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.546956 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.547111 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.547018 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.547269 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.547238 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.547407 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.547385 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.547526 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.547503 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.547975 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.547948 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.549301 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.549187 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.549301 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.549282 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.549728 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.549684 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-config-out\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.549814 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.549796 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.549902 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.549878 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.549958 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.549878 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.550335 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.550318 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.550748 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.550727 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.551397 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.551371 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.551546 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.551528 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-web-config\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.551667 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.551649 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-config\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.555662 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.555640 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5h4q\" (UniqueName: \"kubernetes.io/projected/2004e9f5-66aa-4bab-a29b-5f999a8c2fc3-kube-api-access-w5h4q\") pod \"prometheus-k8s-0\" (UID: \"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.678031 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.677991 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:46:12.859193 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:12.859170 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 20:46:12.861477 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:46:12.861448 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2004e9f5_66aa_4bab_a29b_5f999a8c2fc3.slice/crio-e1b428799de3aac9494755f4e91b5d4dda7a4f8dad9edb1f3173bffbf6946928 WatchSource:0}: Error finding container e1b428799de3aac9494755f4e91b5d4dda7a4f8dad9edb1f3173bffbf6946928: Status 404 returned error can't find the container with id e1b428799de3aac9494755f4e91b5d4dda7a4f8dad9edb1f3173bffbf6946928 Jul 06 20:46:13.306535 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:13.306432 2579 generic.go:356] "Generic (PLEG): container finished" podID="2004e9f5-66aa-4bab-a29b-5f999a8c2fc3" containerID="371da498595825bb6b990d24b558209787a8efaf73ef8048d483d487a4a43a78" exitCode=0 Jul 06 20:46:13.306988 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:13.306521 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3","Type":"ContainerDied","Data":"371da498595825bb6b990d24b558209787a8efaf73ef8048d483d487a4a43a78"} Jul 06 20:46:13.306988 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:13.306617 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3","Type":"ContainerStarted","Data":"e1b428799de3aac9494755f4e91b5d4dda7a4f8dad9edb1f3173bffbf6946928"} Jul 06 20:46:13.426971 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:13.426931 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dd4fd7e-236a-48f4-80dd-17a05f8298af" path="/var/lib/kubelet/pods/6dd4fd7e-236a-48f4-80dd-17a05f8298af/volumes" Jul 06 20:46:14.313883 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:14.313846 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3","Type":"ContainerStarted","Data":"85f8214810c443951fbbf29a7392ba3441a9a6ad22488589bd8e5efbf063366d"} Jul 06 20:46:14.314374 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:14.313949 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3","Type":"ContainerStarted","Data":"02daed7f60f9cf39393bd75cb846b85cbd24ccd08dbc4be8c58e2d9a075c3c93"} Jul 06 20:46:14.314374 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:14.314000 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3","Type":"ContainerStarted","Data":"66dc731e3094ddbe24458a62efd954bac674900ea936016092a67412d4528300"} Jul 06 20:46:14.314374 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:14.314030 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3","Type":"ContainerStarted","Data":"970e14de9ef2964ef55d4381492000e5945787c0dd0edce99154573e1f85b533"} Jul 06 20:46:14.314374 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:14.314074 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3","Type":"ContainerStarted","Data":"fe9490cdc82f033b18508ffd48f1fe17c4747d4e64cc43cbba927157cb0c5965"} Jul 06 20:46:14.314374 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:14.314115 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2004e9f5-66aa-4bab-a29b-5f999a8c2fc3","Type":"ContainerStarted","Data":"60ef012661f6b94d81a6bc4730286009d3d152fc5ec125caca840572f4a4555c"} Jul 06 20:46:14.315953 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:14.315929 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" event={"ID":"17a1dd23-8672-4551-a6d2-67b974c95715","Type":"ContainerStarted","Data":"959a9db4e8a966f8d2a464dc72430b37ad408d57d7aa60d0b4eccc816df58d4b"} Jul 06 20:46:14.316071 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:14.315972 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" event={"ID":"17a1dd23-8672-4551-a6d2-67b974c95715","Type":"ContainerStarted","Data":"f2a3949d343760c599f27651467c9f14697a3315db1366320b380371fc1a7cfa"} Jul 06 20:46:14.316071 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:14.315995 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" event={"ID":"17a1dd23-8672-4551-a6d2-67b974c95715","Type":"ContainerStarted","Data":"e81ea0dd93b9fab9f37c09aa22309d27cdbcd71c420202828f5fbb8b30d920c3"} Jul 06 20:46:14.349300 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:14.349239 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.32365762 podStartE2EDuration="2.349219783s" totalImagesPullingTime="0s" totalInitContainerRuntime="25.562163ms" isStatefulPod=false podCreationTimestamp="2026-07-06 20:46:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:46:14.347917122 +0000 UTC m=+198.436422182" watchObservedRunningTime="2026-07-06 20:46:14.349219783 +0000 UTC m=+198.437724821" Jul 06 20:46:14.369697 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:14.369639 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-56645f9db4-bbh4z" podStartSLOduration=2.136443261 podStartE2EDuration="4.369622733s" totalImagesPullingTime="2.233179472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:46:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:46:14.36820011 +0000 UTC m=+198.456705150" watchObservedRunningTime="2026-07-06 20:46:14.369622733 +0000 UTC m=+198.458127771" Jul 06 20:46:17.678779 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:46:17.678723 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:47:12.678963 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:47:12.678913 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:47:12.694569 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:47:12.694540 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:47:13.568215 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:47:13.568187 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 20:47:57.326301 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:47:57.326269 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltvbf_e8a0e0f0-fbb4-4da3-b737-76c41c58aabc/ovn-acl-logging/0.log" Jul 06 20:47:57.331309 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:47:57.331282 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltvbf_e8a0e0f0-fbb4-4da3-b737-76c41c58aabc/ovn-acl-logging/0.log" Jul 06 20:47:57.334087 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:47:57.334068 2579 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 20:48:26.016176 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:26.016142 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-n6q5c_e04d2210-8cbc-4669-a224-efaa7a105a01/global-pull-secret-syncer/0.log" Jul 06 20:48:26.166736 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:26.166703 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hr6nx_03e326a9-6711-4a8d-99ce-99bca6cf4448/konnectivity-agent/0.log" Jul 06 20:48:26.285358 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:26.285279 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-228.ec2.internal_ec203f93224e29c9e448da12179f9229/haproxy/0.log" Jul 06 20:48:29.429770 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:29.429737 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_99a8c366-396f-4f6a-a4c7-813bc310b098/alertmanager/0.log" Jul 06 20:48:29.464721 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:29.464690 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_99a8c366-396f-4f6a-a4c7-813bc310b098/config-reloader/0.log" Jul 06 20:48:29.493344 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:29.493287 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_99a8c366-396f-4f6a-a4c7-813bc310b098/kube-rbac-proxy-web/0.log" Jul 06 20:48:29.525607 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:29.525557 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_99a8c366-396f-4f6a-a4c7-813bc310b098/kube-rbac-proxy/0.log" Jul 06 20:48:29.559407 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:29.559380 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_99a8c366-396f-4f6a-a4c7-813bc310b098/kube-rbac-proxy-metric/0.log" Jul 06 20:48:29.592844 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:29.592815 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_99a8c366-396f-4f6a-a4c7-813bc310b098/prom-label-proxy/0.log" Jul 06 20:48:29.630845 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:29.630822 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_99a8c366-396f-4f6a-a4c7-813bc310b098/init-config-reloader/0.log" Jul 06 20:48:29.683443 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:29.683371 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-9r5rz_14b6e54d-55ec-4e9b-8363-cbb12e017b88/cluster-monitoring-operator/0.log" Jul 06 20:48:30.165974 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.165947 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vjrqn_30282de3-cd34-4069-b411-efcc6a566e35/node-exporter/0.log" Jul 06 20:48:30.195444 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.195419 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vjrqn_30282de3-cd34-4069-b411-efcc6a566e35/kube-rbac-proxy/0.log" Jul 06 20:48:30.232990 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.232935 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vjrqn_30282de3-cd34-4069-b411-efcc6a566e35/init-textfile/0.log" Jul 06 20:48:30.385937 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.385908 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2004e9f5-66aa-4bab-a29b-5f999a8c2fc3/prometheus/0.log" Jul 06 20:48:30.421854 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.421776 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2004e9f5-66aa-4bab-a29b-5f999a8c2fc3/config-reloader/0.log" Jul 06 20:48:30.449875 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.449846 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2004e9f5-66aa-4bab-a29b-5f999a8c2fc3/thanos-sidecar/0.log" Jul 06 20:48:30.479007 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.478979 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2004e9f5-66aa-4bab-a29b-5f999a8c2fc3/kube-rbac-proxy-web/0.log" Jul 06 20:48:30.510944 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.510916 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2004e9f5-66aa-4bab-a29b-5f999a8c2fc3/kube-rbac-proxy/0.log" Jul 06 20:48:30.542106 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.542082 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2004e9f5-66aa-4bab-a29b-5f999a8c2fc3/kube-rbac-proxy-thanos/0.log" Jul 06 20:48:30.575304 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.575269 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2004e9f5-66aa-4bab-a29b-5f999a8c2fc3/init-config-reloader/0.log" Jul 06 20:48:30.613625 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.613582 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4j4nm_7915952c-d4c6-4a33-b340-fa755c89137c/prometheus-operator/0.log" Jul 06 20:48:30.642635 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.642611 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4j4nm_7915952c-d4c6-4a33-b340-fa755c89137c/kube-rbac-proxy/0.log" Jul 06 20:48:30.676469 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.676392 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-dghl8_390e85c0-1abd-4bd3-a8ff-d51f00660b11/prometheus-operator-admission-webhook/0.log" Jul 06 20:48:30.712680 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.712646 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56645f9db4-bbh4z_17a1dd23-8672-4551-a6d2-67b974c95715/telemeter-client/0.log" Jul 06 20:48:30.742504 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.742474 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56645f9db4-bbh4z_17a1dd23-8672-4551-a6d2-67b974c95715/reload/0.log" Jul 06 20:48:30.771417 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.771381 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56645f9db4-bbh4z_17a1dd23-8672-4551-a6d2-67b974c95715/kube-rbac-proxy/0.log" Jul 06 20:48:30.812844 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.812818 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b448b585b-twbg9_9a46c23b-7aa8-46c0-9b13-bc7d847c06d9/thanos-query/0.log" Jul 06 20:48:30.850718 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.850690 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b448b585b-twbg9_9a46c23b-7aa8-46c0-9b13-bc7d847c06d9/kube-rbac-proxy-web/0.log" Jul 06 20:48:30.880030 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.879997 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b448b585b-twbg9_9a46c23b-7aa8-46c0-9b13-bc7d847c06d9/kube-rbac-proxy/0.log" Jul 06 20:48:30.911706 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.911672 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b448b585b-twbg9_9a46c23b-7aa8-46c0-9b13-bc7d847c06d9/prom-label-proxy/0.log" Jul 06 20:48:30.948750 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.948664 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b448b585b-twbg9_9a46c23b-7aa8-46c0-9b13-bc7d847c06d9/kube-rbac-proxy-rules/0.log" Jul 06 20:48:30.979939 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:30.979910 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-b448b585b-twbg9_9a46c23b-7aa8-46c0-9b13-bc7d847c06d9/kube-rbac-proxy-metrics/0.log" Jul 06 20:48:32.229640 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:32.229605 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-fzfzb_19335140-b661-4ef4-a9bc-fd0614754e3e/networking-console-plugin/0.log" Jul 06 20:48:33.230713 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.230676 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz"] Jul 06 20:48:33.234160 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.234135 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.237771 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.237749 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2mjld\"/\"default-dockercfg-rb2v9\"" Jul 06 20:48:33.237908 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.237783 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2mjld\"/\"openshift-service-ca.crt\"" Jul 06 20:48:33.238779 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.238763 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2mjld\"/\"kube-root-ca.crt\"" Jul 06 20:48:33.248240 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.248209 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz"] Jul 06 20:48:33.250288 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.250265 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tthl\" (UniqueName: \"kubernetes.io/projected/e6955983-eaec-46d5-83ce-568ca1d87b8d-kube-api-access-2tthl\") pod \"perf-node-gather-daemonset-h86rz\" (UID: \"e6955983-eaec-46d5-83ce-568ca1d87b8d\") " pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.250392 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.250338 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6955983-eaec-46d5-83ce-568ca1d87b8d-podres\") pod \"perf-node-gather-daemonset-h86rz\" (UID: \"e6955983-eaec-46d5-83ce-568ca1d87b8d\") " pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.250392 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.250374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6955983-eaec-46d5-83ce-568ca1d87b8d-lib-modules\") pod \"perf-node-gather-daemonset-h86rz\" (UID: \"e6955983-eaec-46d5-83ce-568ca1d87b8d\") " pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.250472 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.250406 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6955983-eaec-46d5-83ce-568ca1d87b8d-proc\") pod \"perf-node-gather-daemonset-h86rz\" (UID: \"e6955983-eaec-46d5-83ce-568ca1d87b8d\") " pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.250507 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.250473 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6955983-eaec-46d5-83ce-568ca1d87b8d-sys\") pod \"perf-node-gather-daemonset-h86rz\" (UID: \"e6955983-eaec-46d5-83ce-568ca1d87b8d\") " pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.350882 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.350850 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6955983-eaec-46d5-83ce-568ca1d87b8d-lib-modules\") pod \"perf-node-gather-daemonset-h86rz\" (UID: \"e6955983-eaec-46d5-83ce-568ca1d87b8d\") " pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.350882 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.350894 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6955983-eaec-46d5-83ce-568ca1d87b8d-proc\") pod \"perf-node-gather-daemonset-h86rz\" (UID: \"e6955983-eaec-46d5-83ce-568ca1d87b8d\") " pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.351337 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.350913 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6955983-eaec-46d5-83ce-568ca1d87b8d-sys\") pod \"perf-node-gather-daemonset-h86rz\" (UID: \"e6955983-eaec-46d5-83ce-568ca1d87b8d\") " pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.351337 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.350941 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tthl\" (UniqueName: \"kubernetes.io/projected/e6955983-eaec-46d5-83ce-568ca1d87b8d-kube-api-access-2tthl\") pod \"perf-node-gather-daemonset-h86rz\" (UID: \"e6955983-eaec-46d5-83ce-568ca1d87b8d\") " pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.351337 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.350994 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6955983-eaec-46d5-83ce-568ca1d87b8d-podres\") pod \"perf-node-gather-daemonset-h86rz\" (UID: \"e6955983-eaec-46d5-83ce-568ca1d87b8d\") " pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.351337 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.351002 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6955983-eaec-46d5-83ce-568ca1d87b8d-proc\") pod \"perf-node-gather-daemonset-h86rz\" (UID: \"e6955983-eaec-46d5-83ce-568ca1d87b8d\") " pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.351337 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.351065 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6955983-eaec-46d5-83ce-568ca1d87b8d-lib-modules\") pod \"perf-node-gather-daemonset-h86rz\" (UID: \"e6955983-eaec-46d5-83ce-568ca1d87b8d\") " pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.351337 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.351007 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6955983-eaec-46d5-83ce-568ca1d87b8d-sys\") pod \"perf-node-gather-daemonset-h86rz\" (UID: \"e6955983-eaec-46d5-83ce-568ca1d87b8d\") " pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.351337 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.351117 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6955983-eaec-46d5-83ce-568ca1d87b8d-podres\") pod \"perf-node-gather-daemonset-h86rz\" (UID: \"e6955983-eaec-46d5-83ce-568ca1d87b8d\") " pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.363630 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.363595 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tthl\" (UniqueName: \"kubernetes.io/projected/e6955983-eaec-46d5-83ce-568ca1d87b8d-kube-api-access-2tthl\") pod \"perf-node-gather-daemonset-h86rz\" (UID: \"e6955983-eaec-46d5-83ce-568ca1d87b8d\") " pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.543949 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.543857 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.674693 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.674669 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz"] Jul 06 20:48:33.677386 ip-10-0-134-228 kubenswrapper[2579]: W0706 20:48:33.677360 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode6955983_eaec_46d5_83ce_568ca1d87b8d.slice/crio-aa7ac46fe480384dca09c769bbd961963701f9f65f83fa694aaed8a9b16b1ac3 WatchSource:0}: Error finding container aa7ac46fe480384dca09c769bbd961963701f9f65f83fa694aaed8a9b16b1ac3: Status 404 returned error can't find the container with id aa7ac46fe480384dca09c769bbd961963701f9f65f83fa694aaed8a9b16b1ac3 Jul 06 20:48:33.867341 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.867299 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" event={"ID":"e6955983-eaec-46d5-83ce-568ca1d87b8d","Type":"ContainerStarted","Data":"b03e13d1bdf1b632669327065918743a447214b9f4edb25335719fffdfbc0e80"} Jul 06 20:48:33.867533 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.867363 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" event={"ID":"e6955983-eaec-46d5-83ce-568ca1d87b8d","Type":"ContainerStarted","Data":"aa7ac46fe480384dca09c769bbd961963701f9f65f83fa694aaed8a9b16b1ac3"} Jul 06 20:48:33.867533 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.867445 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:33.888978 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:33.888923 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" podStartSLOduration=0.888905959 podStartE2EDuration="888.905959ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:48:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:48:33.888202895 +0000 UTC m=+337.976707933" watchObservedRunningTime="2026-07-06 20:48:33.888905959 +0000 UTC m=+337.977410996" Jul 06 20:48:34.955766 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:34.955728 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hz7nr_5030b055-0d90-462d-896c-b8de4f05030b/dns/0.log" Jul 06 20:48:34.986075 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:34.986037 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hz7nr_5030b055-0d90-462d-896c-b8de4f05030b/kube-rbac-proxy/0.log" Jul 06 20:48:35.160418 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:35.160381 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2n66c_e2731a50-9ac2-464f-93ff-1baaade87306/dns-node-resolver/0.log" Jul 06 20:48:35.697850 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:35.697822 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cwdkh_e33c4557-9986-481f-8088-cc0142641a11/node-ca/0.log" Jul 06 20:48:36.989909 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:36.989874 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vwzxl_fbb6eb95-ccd2-43af-90e5-b33900e750af/serve-healthcheck-canary/0.log" Jul 06 20:48:37.423090 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:37.423039 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8s8rq_853c3eb3-b77b-493c-80e1-3bcddf56ee0f/kube-rbac-proxy/0.log" Jul 06 20:48:37.470221 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:37.470185 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8s8rq_853c3eb3-b77b-493c-80e1-3bcddf56ee0f/exporter/0.log" Jul 06 20:48:37.511849 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:37.511819 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8s8rq_853c3eb3-b77b-493c-80e1-3bcddf56ee0f/extractor/0.log" Jul 06 20:48:39.882295 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:39.882251 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2mjld/perf-node-gather-daemonset-h86rz" Jul 06 20:48:44.162514 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:44.162481 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qlv6j_811731cd-7f4e-4167-bc87-26a30d2c5ab3/kube-multus-additional-cni-plugins/0.log" Jul 06 20:48:44.189491 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:44.189463 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qlv6j_811731cd-7f4e-4167-bc87-26a30d2c5ab3/egress-router-binary-copy/0.log" Jul 06 20:48:44.216188 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:44.216160 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qlv6j_811731cd-7f4e-4167-bc87-26a30d2c5ab3/cni-plugins/0.log" Jul 06 20:48:44.243934 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:44.243901 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qlv6j_811731cd-7f4e-4167-bc87-26a30d2c5ab3/bond-cni-plugin/0.log" Jul 06 20:48:44.270346 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:44.270319 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qlv6j_811731cd-7f4e-4167-bc87-26a30d2c5ab3/routeoverride-cni/0.log" Jul 06 20:48:44.301246 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:44.301219 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qlv6j_811731cd-7f4e-4167-bc87-26a30d2c5ab3/whereabouts-cni-bincopy/0.log" Jul 06 20:48:44.328147 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:44.328122 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qlv6j_811731cd-7f4e-4167-bc87-26a30d2c5ab3/whereabouts-cni/0.log" Jul 06 20:48:44.806108 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:44.806079 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cs6cf_d58f76fe-a5fa-4b7d-874d-f4eb85335772/kube-multus/0.log" Jul 06 20:48:44.923691 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:44.923662 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4ktj2_774becc8-6fe2-4ec6-aabf-a63925f4a0a6/network-metrics-daemon/0.log" Jul 06 20:48:44.963975 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:44.963886 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4ktj2_774becc8-6fe2-4ec6-aabf-a63925f4a0a6/kube-rbac-proxy/0.log" Jul 06 20:48:46.723099 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:46.723027 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltvbf_e8a0e0f0-fbb4-4da3-b737-76c41c58aabc/ovn-controller/0.log" Jul 06 20:48:46.759937 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:46.759901 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltvbf_e8a0e0f0-fbb4-4da3-b737-76c41c58aabc/ovn-acl-logging/0.log" Jul 06 20:48:46.760118 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:46.759908 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltvbf_e8a0e0f0-fbb4-4da3-b737-76c41c58aabc/ovn-acl-logging/1.log" Jul 06 20:48:46.793235 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:46.793206 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltvbf_e8a0e0f0-fbb4-4da3-b737-76c41c58aabc/kube-rbac-proxy-node/0.log" Jul 06 20:48:46.846222 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:46.846198 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltvbf_e8a0e0f0-fbb4-4da3-b737-76c41c58aabc/kube-rbac-proxy-ovn-metrics/0.log" Jul 06 20:48:46.889145 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:46.889113 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltvbf_e8a0e0f0-fbb4-4da3-b737-76c41c58aabc/northd/0.log" Jul 06 20:48:46.929596 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:46.929568 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltvbf_e8a0e0f0-fbb4-4da3-b737-76c41c58aabc/nbdb/0.log" Jul 06 20:48:46.967384 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:46.967358 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltvbf_e8a0e0f0-fbb4-4da3-b737-76c41c58aabc/sbdb/0.log" Jul 06 20:48:47.025687 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:47.025602 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ltvbf_e8a0e0f0-fbb4-4da3-b737-76c41c58aabc/ovnkube-controller/0.log" Jul 06 20:48:48.344851 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:48.344778 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-trdb7_4861643d-0031-4262-ae60-9b5b94bef4a9/network-check-target-container/0.log" Jul 06 20:48:49.366647 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:49.366617 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-hxxkh_cafb342c-2194-450e-929d-4e0e4caac245/iptables-alerter/0.log" Jul 06 20:48:50.142568 ip-10-0-134-228 kubenswrapper[2579]: I0706 20:48:50.142537 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-jvbmc_d1f16363-8540-46b1-8d6d-8e2b60b309a8/tuned/0.log"