Jul 31 16:45:20.036130 ip-10-0-140-127 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 31 16:45:20.036146 ip-10-0-140-127 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 31 16:45:20.036157 ip-10-0-140-127 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 31 16:45:20.036514 ip-10-0-140-127 systemd[1]: Failed to start Kubernetes Kubelet. Jul 31 16:45:30.086756 ip-10-0-140-127 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 31 16:45:30.086780 ip-10-0-140-127 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e3bfbd54a6704fe7850ca972d0acff44 -- Jul 31 16:46:58.722689 ip-10-0-140-127 systemd[1]: Starting Kubernetes Kubelet... Jul 31 16:46:59.163269 ip-10-0-140-127 kubenswrapper[2586]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 16:46:59.163269 ip-10-0-140-127 kubenswrapper[2586]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 31 16:46:59.163269 ip-10-0-140-127 kubenswrapper[2586]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 16:46:59.163269 ip-10-0-140-127 kubenswrapper[2586]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 31 16:46:59.163269 ip-10-0-140-127 kubenswrapper[2586]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 31 16:46:59.166207 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.166108 2586 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 31 16:46:59.172252 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172232 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 16:46:59.172252 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172248 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 16:46:59.172252 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172253 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 16:46:59.172252 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172258 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172263 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172267 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172271 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172275 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172279 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172283 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172287 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172290 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172294 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172298 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172302 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172306 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172310 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172313 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172317 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172321 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172336 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172340 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172345 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 16:46:59.172532 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172349 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172353 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172356 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172360 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172365 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172369 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172373 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172377 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172393 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172398 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172404 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172409 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172413 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172417 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172423 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172428 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172432 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172436 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172441 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172445 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 16:46:59.173329 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172449 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172453 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172457 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172462 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172466 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172471 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172475 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172479 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172483 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172487 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172492 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172497 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172501 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172506 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172510 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172514 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172518 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172523 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172527 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172531 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 16:46:59.173917 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172535 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172539 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172543 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172547 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172552 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172556 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172561 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172565 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172569 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172574 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172578 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172587 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172595 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172601 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172608 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172615 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172620 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172625 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172630 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 16:46:59.174507 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172635 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172639 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172644 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172649 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172653 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172658 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172662 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172666 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172670 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172674 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172679 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172683 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172687 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172691 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172696 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172700 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.172704 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.174914 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.174926 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 16:46:59.175290 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.174931 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.174936 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.174940 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.174945 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.174949 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.174954 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.174958 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.174964 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.174971 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.174977 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.174982 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.174987 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.174992 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.174996 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175000 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175004 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175008 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175012 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175018 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 16:46:59.176047 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175023 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175027 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175031 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175036 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175041 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175046 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175050 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175054 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175059 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175063 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175067 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175071 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175076 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175080 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175084 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175088 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175092 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175097 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175102 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175106 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 16:46:59.176808 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175110 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175114 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175118 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175123 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175127 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175131 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175136 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175140 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175145 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175149 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175153 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175158 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175165 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175170 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175174 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175179 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175187 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175191 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175196 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175200 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 16:46:59.177336 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175205 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175209 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175213 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175218 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175222 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175226 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175231 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175235 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175242 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175246 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175250 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175254 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175258 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175263 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175267 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175271 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175278 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175283 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175287 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175292 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 16:46:59.177843 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175296 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175300 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175304 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175308 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175312 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175317 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175321 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175326 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175331 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175336 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175340 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175345 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175349 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175353 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175359 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175364 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175369 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.175374 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177268 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177279 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 16:46:59.178345 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177283 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177287 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177289 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177292 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177295 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177297 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177302 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177306 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177309 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177312 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177315 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177318 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177320 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177322 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177326 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177328 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177331 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177334 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177336 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 16:46:59.178856 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177339 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177342 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177345 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177347 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177350 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177352 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177356 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177358 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177361 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177363 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177366 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177369 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177372 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177375 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177377 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177398 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177401 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177404 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177406 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177409 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 16:46:59.179297 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177412 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177416 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177420 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177423 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177426 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177428 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177431 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177433 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177436 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177438 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177440 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177443 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177445 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177448 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177450 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177453 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177456 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177458 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177461 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177463 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 16:46:59.179801 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177466 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177469 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177472 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177474 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177478 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177480 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177483 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177485 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177488 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177492 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177494 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177497 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177500 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177502 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177505 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177507 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177510 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177512 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177515 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177517 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 16:46:59.180277 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177520 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177522 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177525 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177528 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177530 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177533 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177535 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177538 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177540 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177543 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177545 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177548 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177550 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177553 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177555 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177558 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177563 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.177568 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177652 2586 flags.go:64] FLAG: --address="0.0.0.0" Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177663 2586 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 31 16:46:59.180792 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177674 2586 flags.go:64] FLAG: --anonymous-auth="true" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177681 2586 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177685 2586 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177688 2586 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177693 2586 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177698 2586 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177701 2586 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177703 2586 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177707 2586 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177710 2586 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177713 2586 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177716 2586 flags.go:64] FLAG: --cgroup-root="" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177719 2586 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177722 2586 flags.go:64] FLAG: --client-ca-file="" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177725 2586 flags.go:64] FLAG: --cloud-provider="external" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177728 2586 flags.go:64] FLAG: --cluster-dns="[]" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177733 2586 flags.go:64] FLAG: --cluster-domain="" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177735 2586 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177738 2586 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177741 2586 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177745 2586 flags.go:64] FLAG: --container-log-max-files="5" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177749 2586 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177752 2586 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 31 16:46:59.181263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177755 2586 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177758 2586 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177761 2586 flags.go:64] FLAG: --contention-profiling="false" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177764 2586 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177767 2586 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177774 2586 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177777 2586 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177781 2586 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177784 2586 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177787 2586 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177790 2586 flags.go:64] FLAG: --enable-load-reader="false" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177793 2586 flags.go:64] FLAG: --enable-server="true" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177796 2586 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177802 2586 flags.go:64] FLAG: --event-burst="100" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177805 2586 flags.go:64] FLAG: --event-qps="50" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177808 2586 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177811 2586 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177814 2586 flags.go:64] FLAG: --eviction-hard="" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177818 2586 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177821 2586 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177824 2586 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177826 2586 flags.go:64] FLAG: --eviction-soft="" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177829 2586 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177833 2586 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177836 2586 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 31 16:46:59.182050 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177839 2586 flags.go:64] FLAG: --experimental-mounter-path="" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177842 2586 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177845 2586 flags.go:64] FLAG: --fail-swap-on="true" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177856 2586 flags.go:64] FLAG: --feature-gates="" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177861 2586 flags.go:64] FLAG: --file-check-frequency="20s" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177864 2586 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177868 2586 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177871 2586 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177874 2586 flags.go:64] FLAG: --healthz-port="10248" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177877 2586 flags.go:64] FLAG: --help="false" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177880 2586 flags.go:64] FLAG: --hostname-override="ip-10-0-140-127.ec2.internal" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177883 2586 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177888 2586 flags.go:64] FLAG: --http-check-frequency="20s" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177891 2586 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177895 2586 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177898 2586 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177901 2586 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177904 2586 flags.go:64] FLAG: --image-service-endpoint="" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177907 2586 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177910 2586 flags.go:64] FLAG: --kube-api-burst="100" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177913 2586 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177916 2586 flags.go:64] FLAG: --kube-api-qps="50" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177919 2586 flags.go:64] FLAG: --kube-reserved="" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177922 2586 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 31 16:46:59.183076 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177925 2586 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177928 2586 flags.go:64] FLAG: --kubelet-cgroups="" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177930 2586 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177933 2586 flags.go:64] FLAG: --lock-file="" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177936 2586 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177939 2586 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177941 2586 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177947 2586 flags.go:64] FLAG: --log-json-split-stream="false" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177950 2586 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177953 2586 flags.go:64] FLAG: --log-text-split-stream="false" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177956 2586 flags.go:64] FLAG: --logging-format="text" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177959 2586 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177962 2586 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177965 2586 flags.go:64] FLAG: --manifest-url="" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177968 2586 flags.go:64] FLAG: --manifest-url-header="" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177972 2586 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177976 2586 flags.go:64] FLAG: --max-open-files="1000000" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177980 2586 flags.go:64] FLAG: --max-pods="110" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177983 2586 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177986 2586 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177991 2586 flags.go:64] FLAG: --memory-manager-policy="None" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177995 2586 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.177997 2586 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178000 2586 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178003 2586 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 31 16:46:59.184001 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178015 2586 flags.go:64] FLAG: --node-status-max-images="50" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178018 2586 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178021 2586 flags.go:64] FLAG: --oom-score-adj="-999" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178024 2586 flags.go:64] FLAG: --pod-cidr="" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178027 2586 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178033 2586 flags.go:64] FLAG: --pod-manifest-path="" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178035 2586 flags.go:64] FLAG: --pod-max-pids="-1" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178038 2586 flags.go:64] FLAG: --pods-per-core="0" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178041 2586 flags.go:64] FLAG: --port="10250" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178044 2586 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178047 2586 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02eda4b80fb903552" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178051 2586 flags.go:64] FLAG: --qos-reserved="" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178054 2586 flags.go:64] FLAG: --read-only-port="10255" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178057 2586 flags.go:64] FLAG: --register-node="true" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178060 2586 flags.go:64] FLAG: --register-with-taints="" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178064 2586 flags.go:64] FLAG: --registry-burst="10" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178067 2586 flags.go:64] FLAG: --registry-qps="5" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178070 2586 flags.go:64] FLAG: --reserved-cpus="" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178073 2586 flags.go:64] FLAG: --reserved-memory="" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178076 2586 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178079 2586 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178082 2586 flags.go:64] FLAG: --rotate-certificates="false" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178085 2586 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178088 2586 flags.go:64] FLAG: --runonce="false" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178091 2586 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 31 16:46:59.184944 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178094 2586 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178097 2586 flags.go:64] FLAG: --seccomp-default="false" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178104 2586 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178109 2586 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178112 2586 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178115 2586 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178118 2586 flags.go:64] FLAG: --storage-driver-password="root" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178121 2586 flags.go:64] FLAG: --storage-driver-secure="false" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178124 2586 flags.go:64] FLAG: --storage-driver-table="stats" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178127 2586 flags.go:64] FLAG: --storage-driver-user="root" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178130 2586 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178133 2586 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178136 2586 flags.go:64] FLAG: --system-cgroups="" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178139 2586 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178144 2586 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178147 2586 flags.go:64] FLAG: --tls-cert-file="" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178150 2586 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178154 2586 flags.go:64] FLAG: --tls-min-version="" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178157 2586 flags.go:64] FLAG: --tls-private-key-file="" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178160 2586 flags.go:64] FLAG: --topology-manager-policy="none" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178162 2586 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178165 2586 flags.go:64] FLAG: --topology-manager-scope="container" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178168 2586 flags.go:64] FLAG: --v="2" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178172 2586 flags.go:64] FLAG: --version="false" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178176 2586 flags.go:64] FLAG: --vmodule="" Jul 31 16:46:59.185890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178180 2586 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.178184 2586 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178299 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178303 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178307 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178311 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178314 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178317 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178320 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178324 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178328 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178331 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178334 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178336 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178339 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178342 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178345 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178348 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178351 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 16:46:59.186809 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178353 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178357 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178359 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178362 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178365 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178367 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178370 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178373 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178375 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178378 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178392 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178395 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178397 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178401 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178404 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178407 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178409 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178412 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178415 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178417 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 16:46:59.187539 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178420 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178423 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178426 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178430 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178434 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178438 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178441 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178444 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178447 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178450 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178452 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178455 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178458 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178460 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178463 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178465 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178468 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178471 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178474 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 16:46:59.188278 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178476 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178479 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178482 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178484 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178487 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178489 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178492 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178495 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178498 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178501 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178503 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178506 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178508 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178511 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178513 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178518 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178522 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178525 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178527 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178530 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 16:46:59.189021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178532 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178535 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178537 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178540 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178543 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178545 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178548 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178551 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178553 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178556 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178558 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178561 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178563 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178566 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178568 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178571 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178573 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178576 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178579 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178581 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 16:46:59.189838 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178584 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 16:46:59.190596 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178588 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 16:46:59.190596 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.178592 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 16:46:59.190596 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.179258 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 16:46:59.190596 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.188667 2586 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 31 16:46:59.190596 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.188684 2586 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 31 16:46:59.190596 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.188705 2586 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 31 16:46:59.190596 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.188710 2586 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 31 16:46:59.190596 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188786 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 16:46:59.190596 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188791 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 16:46:59.190596 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188795 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 16:46:59.190596 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188798 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 16:46:59.190596 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188802 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 16:46:59.190596 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188805 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 16:46:59.190596 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188808 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188810 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188813 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188816 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188819 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188822 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188824 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188827 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188830 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188832 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188835 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188837 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188840 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188843 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188845 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188849 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188852 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188854 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188858 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188861 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 16:46:59.191125 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188864 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188866 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188869 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188872 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188874 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188877 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188879 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188882 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188886 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188889 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188892 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188895 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188898 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188901 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188904 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188908 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188911 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188914 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188916 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 16:46:59.191861 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188919 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188921 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188924 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188927 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188929 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188932 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188935 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188937 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188940 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188943 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188946 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188948 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188952 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188955 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188957 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188960 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188963 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188965 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188968 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188970 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 16:46:59.192592 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188973 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188976 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188978 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188981 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188983 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188986 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188988 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188991 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188993 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188996 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.188998 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189001 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189004 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189007 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189009 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189012 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189015 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189017 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189020 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189024 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 16:46:59.193330 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189028 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 16:46:59.194295 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189031 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 16:46:59.194295 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189034 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 16:46:59.194295 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189037 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 16:46:59.194295 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189040 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 16:46:59.194295 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189043 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 16:46:59.194295 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189046 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 16:46:59.194295 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189049 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 16:46:59.194295 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189052 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 16:46:59.194295 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189055 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 16:46:59.194295 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189057 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 16:46:59.194295 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189060 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 16:46:59.194295 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189063 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 16:46:59.194295 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189066 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 16:46:59.194295 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.189071 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 16:46:59.194295 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189212 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189217 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189220 2586 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189223 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189226 2586 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189229 2586 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189232 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189235 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189237 2586 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189240 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189243 2586 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189245 2586 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189248 2586 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189250 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189252 2586 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189255 2586 feature_gate.go:328] unrecognized feature gate: Example Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189258 2586 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189262 2586 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189264 2586 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 31 16:46:59.194877 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189268 2586 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189272 2586 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189275 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189279 2586 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189282 2586 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189285 2586 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189288 2586 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189291 2586 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189294 2586 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189296 2586 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189299 2586 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189302 2586 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189304 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189307 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189310 2586 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189312 2586 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189315 2586 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189317 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189320 2586 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189323 2586 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 31 16:46:59.195600 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189325 2586 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189329 2586 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189332 2586 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189335 2586 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189338 2586 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189341 2586 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189344 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189347 2586 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189350 2586 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189354 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189357 2586 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189360 2586 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189363 2586 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189365 2586 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189368 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189371 2586 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189374 2586 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189377 2586 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189395 2586 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 31 16:46:59.196406 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189399 2586 feature_gate.go:328] unrecognized feature gate: Example2 Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189402 2586 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189404 2586 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189407 2586 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189410 2586 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189413 2586 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189415 2586 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189418 2586 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189420 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189423 2586 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189426 2586 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189428 2586 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189431 2586 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189433 2586 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189436 2586 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189439 2586 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189442 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189445 2586 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189447 2586 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189450 2586 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 31 16:46:59.197123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189453 2586 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189455 2586 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189458 2586 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189460 2586 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189463 2586 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189466 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189468 2586 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189471 2586 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189474 2586 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189477 2586 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189479 2586 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189482 2586 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189485 2586 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189487 2586 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189490 2586 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189493 2586 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189495 2586 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189498 2586 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189500 2586 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 31 16:46:59.198004 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189503 2586 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 31 16:46:59.198714 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:46:59.189505 2586 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 31 16:46:59.198714 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.189511 2586 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 31 16:46:59.198714 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.189626 2586 server.go:962] "Client rotation is on, will bootstrap in background" Jul 31 16:46:59.198714 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.191978 2586 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 31 16:46:59.198714 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.193465 2586 server.go:1019] "Starting client certificate rotation" Jul 31 16:46:59.198714 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.193563 2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 31 16:46:59.198714 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.193598 2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 31 16:46:59.198714 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.196211 2586 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 31 16:46:59.199838 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.199822 2586 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 31 16:46:59.207974 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.207953 2586 log.go:25] "Validated CRI v1 runtime API" Jul 31 16:46:59.211713 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.211695 2586 log.go:25] "Validated CRI v1 image API" Jul 31 16:46:59.213461 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.213446 2586 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 31 16:46:59.217516 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.217496 2586 fs.go:135] Filesystem UUIDs: map[19fb8d54-e484-4b1f-a375-738cfcc360e5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ec5f9126-b622-4e6c-82ef-e860853b5a4a:/dev/nvme0n1p3] Jul 31 16:46:59.217608 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.217514 2586 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 31 16:46:59.225484 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.225309 2586 manager.go:216] Machine: {Timestamp:2026-07-31 16:46:59.224580073 +0000 UTC m=+0.373674869 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100324 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2be133eb9ba9efb6481e11d78afbc0 SystemUUID:ec2be133-eb9b-a9ef-b648-1e11d78afbc0 BootID:e3bfbd54-a670-4fe7-850c-a972d0acff44 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:04:a8:6b:9a:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:04:a8:6b:9a:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:7d:87:29:d9:71 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 31 16:46:59.225484 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.225471 2586 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 31 16:46:59.225638 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.225627 2586 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 31 16:46:59.229072 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.229054 2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 31 16:46:59.230403 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.230364 2586 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 31 16:46:59.230552 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.230407 2586 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-127.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 31 16:46:59.232011 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.232001 2586 topology_manager.go:138] "Creating topology manager with none policy" Jul 31 16:46:59.232047 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.232015 2586 container_manager_linux.go:309] "Creating device plugin manager" Jul 31 16:46:59.232047 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.232023 2586 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 31 16:46:59.232971 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.232960 2586 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 31 16:46:59.234055 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.234045 2586 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 31 16:46:59.238949 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.238937 2586 state_mem.go:36] "Initialized new in-memory state store" Jul 31 16:46:59.239081 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.239071 2586 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 31 16:46:59.239114 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.239105 2586 kubelet.go:486] "Attempting to sync node with API server" Jul 31 16:46:59.239149 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.239118 2586 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 31 16:46:59.239149 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.239133 2586 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 31 16:46:59.239149 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.239142 2586 kubelet.go:398] "Adding apiserver pod source" Jul 31 16:46:59.239270 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.239151 2586 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 31 16:46:59.239563 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.239549 2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 31 16:46:59.239563 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.239568 2586 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 31 16:46:59.241958 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.241940 2586 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 31 16:46:59.244074 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.244059 2586 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 31 16:46:59.244117 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.244099 2586 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 31 16:46:59.245573 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.245560 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 31 16:46:59.245608 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.245580 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 31 16:46:59.245608 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.245588 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 31 16:46:59.245608 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.245596 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 31 16:46:59.245697 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.245609 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 31 16:46:59.245697 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.245617 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 31 16:46:59.245697 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.245628 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 31 16:46:59.245697 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.245636 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 31 16:46:59.245697 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.245646 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 31 16:46:59.245697 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.245654 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 31 16:46:59.245697 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.245665 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 31 16:46:59.245697 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.245673 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 31 16:46:59.247473 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.247461 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 31 16:46:59.247512 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.247476 2586 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 31 16:46:59.250668 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.250645 2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-127.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 31 16:46:59.250772 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.250754 2586 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-127.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 31 16:46:59.251650 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.251631 2586 server.go:1268] "Started kubelet" Jul 31 16:46:59.251805 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.251776 2586 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 31 16:46:59.251930 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.251878 2586 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 31 16:46:59.252045 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.252031 2586 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 31 16:46:59.252196 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.251934 2586 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 31 16:46:59.252628 ip-10-0-140-127 systemd[1]: Started Kubernetes Kubelet. Jul 31 16:46:59.253516 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.253496 2586 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 31 16:46:59.254576 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.254559 2586 server.go:310] "Adding debug handlers to kubelet server" Jul 31 16:46:59.257521 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.256415 2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-127.ec2.internal.18c76db9261ac652 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-127.ec2.internal,UID:ip-10-0-140-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-127.ec2.internal,},FirstTimestamp:2026-07-31 16:46:59.251357266 +0000 UTC m=+0.400452057,LastTimestamp:2026-07-31 16:46:59.251357266 +0000 UTC m=+0.400452057,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-127.ec2.internal,}" Jul 31 16:46:59.257606 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.257564 2586 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 31 16:46:59.261545 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.261528 2586 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 31 16:46:59.261545 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.261538 2586 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 31 16:46:59.261831 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.261808 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-127.ec2.internal\" not found" Jul 31 16:46:59.262492 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.262471 2586 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 31 16:46:59.263002 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.262985 2586 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 31 16:46:59.263077 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.263005 2586 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 31 16:46:59.263225 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.263208 2586 reconstruct.go:97] "Volume reconstruction finished" Jul 31 16:46:59.263272 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.263227 2586 reconciler.go:29] "Reconciler: start to sync state" Jul 31 16:46:59.263367 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.263352 2586 factory.go:55] Registering systemd factory Jul 31 16:46:59.263438 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.263373 2586 factory.go:223] Registration of the systemd container factory successfully Jul 31 16:46:59.263660 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.263643 2586 factory.go:153] Registering CRI-O factory Jul 31 16:46:59.263716 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.263665 2586 factory.go:223] Registration of the crio container factory successfully Jul 31 16:46:59.263763 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.263737 2586 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 31 16:46:59.263763 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.263759 2586 factory.go:103] Registering Raw factory Jul 31 16:46:59.263841 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.263774 2586 manager.go:1196] Started watching for new ooms in manager Jul 31 16:46:59.264205 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.264191 2586 manager.go:349] Starting recovery of all containers Jul 31 16:46:59.271279 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.271253 2586 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 31 16:46:59.271279 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.271262 2586 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-127.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 31 16:46:59.275488 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.275465 2586 manager.go:354] Recovery completed Jul 31 16:46:59.280204 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.280192 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 16:46:59.282090 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.282071 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasSufficientMemory" Jul 31 16:46:59.282193 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.282102 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 16:46:59.282193 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.282112 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasSufficientPID" Jul 31 16:46:59.282751 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.282733 2586 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 31 16:46:59.282751 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.282750 2586 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 31 16:46:59.282869 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.282771 2586 state_mem.go:36] "Initialized new in-memory state store" Jul 31 16:46:59.282869 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.282734 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 16:46:59.283567 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.283551 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasSufficientMemory" Jul 31 16:46:59.283632 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.283581 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 16:46:59.283632 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.283595 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasSufficientPID" Jul 31 16:46:59.284358 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.284344 2586 policy_none.go:49] "None policy: Start" Jul 31 16:46:59.284419 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.284365 2586 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 31 16:46:59.284419 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.284396 2586 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 31 16:46:59.284635 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.284555 2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-127.ec2.internal.18c76db927efb4a6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-127.ec2.internal,UID:ip-10-0-140-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-127.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-127.ec2.internal,},FirstTimestamp:2026-07-31 16:46:59.282089126 +0000 UTC m=+0.431183916,LastTimestamp:2026-07-31 16:46:59.282089126 +0000 UTC m=+0.431183916,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-127.ec2.internal,}" Jul 31 16:46:59.285460 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.285448 2586 policy_none.go:47] "Start" Jul 31 16:46:59.293020 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.292948 2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-127.ec2.internal.18c76db927eff8d8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-127.ec2.internal,UID:ip-10-0-140-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-127.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-127.ec2.internal,},FirstTimestamp:2026-07-31 16:46:59.282106584 +0000 UTC m=+0.431201373,LastTimestamp:2026-07-31 16:46:59.282106584 +0000 UTC m=+0.431201373,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-127.ec2.internal,}" Jul 31 16:46:59.295668 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.295600 2586 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-127.ec2.internal.18c76db927f01eda default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-127.ec2.internal,UID:ip-10-0-140-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-127.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-127.ec2.internal,},FirstTimestamp:2026-07-31 16:46:59.282116314 +0000 UTC m=+0.431211104,LastTimestamp:2026-07-31 16:46:59.282116314 +0000 UTC m=+0.431211104,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-127.ec2.internal,}" Jul 31 16:46:59.303938 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.303857 2586 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-127.ec2.internal.18c76db927efb4a6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-127.ec2.internal.18c76db927efb4a6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-127.ec2.internal,UID:ip-10-0-140-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-127.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-127.ec2.internal,},FirstTimestamp:2026-07-31 16:46:59.282089126 +0000 UTC m=+0.431183916,LastTimestamp:2026-07-31 16:46:59.283566333 +0000 UTC m=+0.432661127,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-127.ec2.internal,}" Jul 31 16:46:59.308044 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.308027 2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j8sd2" Jul 31 16:46:59.314896 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.314833 2586 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-127.ec2.internal.18c76db927eff8d8\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-127.ec2.internal.18c76db927eff8d8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-127.ec2.internal,UID:ip-10-0-140-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-127.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-127.ec2.internal,},FirstTimestamp:2026-07-31 16:46:59.282106584 +0000 UTC m=+0.431201373,LastTimestamp:2026-07-31 16:46:59.283587543 +0000 UTC m=+0.432682337,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-127.ec2.internal,}" Jul 31 16:46:59.317479 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.317463 2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j8sd2" Jul 31 16:46:59.319068 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.319054 2586 manager.go:337] "Starting Device Plugin manager" Jul 31 16:46:59.319271 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.319083 2586 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 31 16:46:59.319271 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.319095 2586 server.go:87] "Starting device plugin registration server" Jul 31 16:46:59.319421 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.319359 2586 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 31 16:46:59.319421 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.319371 2586 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 31 16:46:59.319666 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.319484 2586 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 31 16:46:59.319666 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.319555 2586 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 31 16:46:59.319666 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.319562 2586 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 31 16:46:59.320113 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.320046 2586 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 31 16:46:59.320113 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.320096 2586 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-127.ec2.internal\" not found" Jul 31 16:46:59.326071 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.326009 2586 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-127.ec2.internal.18c76db927f01eda\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-127.ec2.internal.18c76db927f01eda default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-127.ec2.internal,UID:ip-10-0-140-127.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-127.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-127.ec2.internal,},FirstTimestamp:2026-07-31 16:46:59.282116314 +0000 UTC m=+0.431211104,LastTimestamp:2026-07-31 16:46:59.283600518 +0000 UTC m=+0.432695312,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-127.ec2.internal,}" Jul 31 16:46:59.344049 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.337257 2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 31 16:46:59.344049 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.338437 2586 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 31 16:46:59.344049 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.338479 2586 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 31 16:46:59.344049 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.338517 2586 kubelet.go:2448] "Starting kubelet main sync loop" Jul 31 16:46:59.344049 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.338554 2586 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 31 16:46:59.344049 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.340140 2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 16:46:59.419624 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.419534 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 16:46:59.420589 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.420571 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasSufficientMemory" Jul 31 16:46:59.420693 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.420600 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 16:46:59.420693 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.420612 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasSufficientPID" Jul 31 16:46:59.420693 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.420642 2586 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-127.ec2.internal" Jul 31 16:46:59.431326 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.431307 2586 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-127.ec2.internal" Jul 31 16:46:59.431402 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.431330 2586 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-127.ec2.internal\": node \"ip-10-0-140-127.ec2.internal\" not found" Jul 31 16:46:59.439370 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.439350 2586 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-127.ec2.internal"] Jul 31 16:46:59.439469 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.439426 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 16:46:59.440276 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.440261 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasSufficientMemory" Jul 31 16:46:59.440342 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.440289 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 16:46:59.440342 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.440302 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasSufficientPID" Jul 31 16:46:59.441567 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.441554 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 16:46:59.441683 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.441668 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal" Jul 31 16:46:59.441722 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.441699 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 16:46:59.442262 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.442246 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasSufficientMemory" Jul 31 16:46:59.442337 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.442276 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 16:46:59.442337 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.442287 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasSufficientPID" Jul 31 16:46:59.442337 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.442246 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasSufficientMemory" Jul 31 16:46:59.442460 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.442352 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 16:46:59.442460 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.442364 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasSufficientPID" Jul 31 16:46:59.443587 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.443569 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-127.ec2.internal" Jul 31 16:46:59.443668 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.443598 2586 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 31 16:46:59.444338 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.444321 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasSufficientMemory" Jul 31 16:46:59.444422 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.444348 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasNoDiskPressure" Jul 31 16:46:59.444422 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.444358 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeHasSufficientPID" Jul 31 16:46:59.447596 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.447582 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-127.ec2.internal\" not found" Jul 31 16:46:59.463941 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.463768 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a869829cad3bc273f8d256f5ab6e77c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal\" (UID: \"a869829cad3bc273f8d256f5ab6e77c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal" Jul 31 16:46:59.464038 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.463951 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e837526304cd459e1a47dbb46a371da-config\") pod \"kube-apiserver-proxy-ip-10-0-140-127.ec2.internal\" (UID: \"0e837526304cd459e1a47dbb46a371da\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-127.ec2.internal" Jul 31 16:46:59.464038 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.463971 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a869829cad3bc273f8d256f5ab6e77c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal\" (UID: \"a869829cad3bc273f8d256f5ab6e77c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal" Jul 31 16:46:59.468044 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.468027 2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-127.ec2.internal\" not found" node="ip-10-0-140-127.ec2.internal" Jul 31 16:46:59.472401 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.472371 2586 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-127.ec2.internal\" not found" node="ip-10-0-140-127.ec2.internal" Jul 31 16:46:59.548668 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.548633 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-127.ec2.internal\" not found" Jul 31 16:46:59.564160 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.564132 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a869829cad3bc273f8d256f5ab6e77c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal\" (UID: \"a869829cad3bc273f8d256f5ab6e77c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal" Jul 31 16:46:59.564160 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.564162 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a869829cad3bc273f8d256f5ab6e77c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal\" (UID: \"a869829cad3bc273f8d256f5ab6e77c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal" Jul 31 16:46:59.564317 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.564180 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e837526304cd459e1a47dbb46a371da-config\") pod \"kube-apiserver-proxy-ip-10-0-140-127.ec2.internal\" (UID: \"0e837526304cd459e1a47dbb46a371da\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-127.ec2.internal" Jul 31 16:46:59.564317 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.564225 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a869829cad3bc273f8d256f5ab6e77c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal\" (UID: \"a869829cad3bc273f8d256f5ab6e77c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal" Jul 31 16:46:59.564317 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.564232 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a869829cad3bc273f8d256f5ab6e77c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal\" (UID: \"a869829cad3bc273f8d256f5ab6e77c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal" Jul 31 16:46:59.564317 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.564274 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e837526304cd459e1a47dbb46a371da-config\") pod \"kube-apiserver-proxy-ip-10-0-140-127.ec2.internal\" (UID: \"0e837526304cd459e1a47dbb46a371da\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-127.ec2.internal" Jul 31 16:46:59.649413 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.649365 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-127.ec2.internal\" not found" Jul 31 16:46:59.750182 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:46:59.750121 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-127.ec2.internal\" not found" Jul 31 16:46:59.771644 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.771624 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal" Jul 31 16:46:59.776602 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:46:59.776512 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-127.ec2.internal" Jul 31 16:47:01.229014 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:01.228975 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-127.ec2.internal\" not found" Jul 31 16:47:01.329508 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:01.329482 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-127.ec2.internal\" not found" Jul 31 16:47:01.430057 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:01.429967 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-127.ec2.internal\" not found" Jul 31 16:47:01.530641 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:01.530603 2586 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-127.ec2.internal\" not found" Jul 31 16:47:01.540949 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.540929 2586 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 16:47:01.570819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.570782 2586 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 31 16:47:01.571272 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.570921 2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 31 16:47:01.571272 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.570963 2586 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 31 16:47:01.618128 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.618100 2586 apiserver.go:52] "Watching apiserver" Jul 31 16:47:01.637180 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.637155 2586 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 31 16:47:01.637494 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.637474 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-fn5jp","kube-system/global-pull-secret-syncer-s2csx","kube-system/konnectivity-agent-hc82h","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd","openshift-dns/node-resolver-v6vm6","openshift-multus/network-metrics-daemon-fmdcm","openshift-network-diagnostics/network-check-target-rdsbm","openshift-cluster-node-tuning-operator/tuned-sfjqm","openshift-image-registry/node-ca-ngdrm","openshift-multus/multus-additional-cni-plugins-bd2mc","openshift-multus/multus-p886w","openshift-network-operator/iptables-alerter-q824w"] Jul 31 16:47:01.638847 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.638828 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.639798 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.639777 2586 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 31 16:47:01.639998 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.639984 2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal" Jul 31 16:47:01.640112 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.640099 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hc82h" Jul 31 16:47:01.641460 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.641433 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:01.641527 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:01.641498 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:01.642176 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.642162 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 31 16:47:01.642532 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.642507 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:01.642637 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:01.642558 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s2csx" podUID="7528c182-537a-43db-b0bd-5633029d814c" Jul 31 16:47:01.643213 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.643194 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 31 16:47:01.643586 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.643565 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 31 16:47:01.643875 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.643857 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.644794 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.644777 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 31 16:47:01.644876 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.644821 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lj7f4\"" Jul 31 16:47:01.644876 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.644836 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 31 16:47:01.645299 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.645286 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v6vm6" Jul 31 16:47:01.645971 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.645946 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-node-log\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.646070 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.645983 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-cni-netd\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.646070 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646010 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-run-ovn\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.646070 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646051 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-cni-bin\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.646230 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646081 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/edb94d9c-3df8-4c0c-bba9-92f25716db88-ovn-node-metrics-cert\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.646230 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646110 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/edb94d9c-3df8-4c0c-bba9-92f25716db88-ovnkube-script-lib\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.646230 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646123 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8ltsp\"" Jul 31 16:47:01.646230 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646134 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0fbfbd18-4216-4c43-8309-b97da0fe3ac2-agent-certs\") pod \"konnectivity-agent-hc82h\" (UID: \"0fbfbd18-4216-4c43-8309-b97da0fe3ac2\") " pod="kube-system/konnectivity-agent-hc82h" Jul 31 16:47:01.646230 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646182 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-slash\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.646230 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646216 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 31 16:47:01.646467 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646216 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-run-systemd\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.646467 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646269 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-var-lib-openvswitch\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.646467 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646294 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-log-socket\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.646788 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646614 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.646788 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646779 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 31 16:47:01.646923 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646806 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/edb94d9c-3df8-4c0c-bba9-92f25716db88-ovnkube-config\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.646923 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646840 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-run-netns\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.646923 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646871 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-run-openvswitch\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.646923 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646916 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-run-ovn-kubernetes\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.647206 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.646982 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/edb94d9c-3df8-4c0c-bba9-92f25716db88-env-overrides\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.647276 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.647249 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s92st\" (UniqueName: \"kubernetes.io/projected/edb94d9c-3df8-4c0c-bba9-92f25716db88-kube-api-access-s92st\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.647329 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.647290 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0fbfbd18-4216-4c43-8309-b97da0fe3ac2-konnectivity-ca\") pod \"konnectivity-agent-hc82h\" (UID: \"0fbfbd18-4216-4c43-8309-b97da0fe3ac2\") " pod="kube-system/konnectivity-agent-hc82h" Jul 31 16:47:01.647379 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.647326 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:01.647427 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.647320 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptdg5\" (UniqueName: \"kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5\") pod \"network-check-target-rdsbm\" (UID: \"c4753a62-82e4-4683-a90d-46ead858670b\") " pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:01.647493 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.647428 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-kubelet\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.647493 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.647479 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-systemd-units\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.647632 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.647558 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-etc-openvswitch\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.648249 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.647190 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 31 16:47:01.648249 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.648236 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 31 16:47:01.649108 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.648668 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dgmnt\"" Jul 31 16:47:01.649108 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.648833 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 31 16:47:01.649247 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.649124 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nrs99\"" Jul 31 16:47:01.649247 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.649173 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 31 16:47:01.649345 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.649305 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 31 16:47:01.649473 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.649437 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 31 16:47:01.649579 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:01.649550 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmdcm" podUID="74210898-48a8-42d3-a8f1-25708d2719cb" Jul 31 16:47:01.650274 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.650249 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.652060 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.651988 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ngdrm" Jul 31 16:47:01.653009 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.652988 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-547n5\"" Jul 31 16:47:01.653118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.653088 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 31 16:47:01.653118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.653101 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 31 16:47:01.653349 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.653332 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.654609 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.654592 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p886w" Jul 31 16:47:01.655634 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.655618 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 31 16:47:01.655781 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.655766 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 31 16:47:01.655853 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.655828 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 31 16:47:01.655907 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.655877 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 31 16:47:01.656379 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.656361 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q824w" Jul 31 16:47:01.657815 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.657798 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 31 16:47:01.658028 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.657901 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 31 16:47:01.658028 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.657923 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 31 16:47:01.658028 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.657926 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 31 16:47:01.658028 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.658025 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fwf6t\"" Jul 31 16:47:01.658231 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.658104 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-q5hjl\"" Jul 31 16:47:01.658350 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.658335 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 31 16:47:01.658593 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.658580 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vmlp6\"" Jul 31 16:47:01.663518 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.663503 2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 31 16:47:01.663618 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.663573 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s5j4s\"" Jul 31 16:47:01.663618 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.663584 2586 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-127.ec2.internal" Jul 31 16:47:01.664331 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.664318 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 31 16:47:01.664415 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.664331 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 31 16:47:01.664415 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.664342 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 31 16:47:01.664902 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.664885 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal"] Jul 31 16:47:01.666611 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.666591 2586 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 31 16:47:01.674919 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.674899 2586 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 31 16:47:01.675015 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.674903 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-127.ec2.internal"] Jul 31 16:47:01.699266 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.699244 2586 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dcx87" Jul 31 16:47:01.703362 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.703337 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-30 16:42:00 +0000 UTC" deadline="2028-04-30 01:30:38.079092888 +0000 UTC" Jul 31 16:47:01.703434 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.703362 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15320h43m36.375733466s" Jul 31 16:47:01.709926 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.709908 2586 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dcx87" Jul 31 16:47:01.741505 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.741484 2586 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 31 16:47:01.741815 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:47:01.741794 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda869829cad3bc273f8d256f5ab6e77c6.slice/crio-87f858e11df3115ce1902fff1c330116e4393977edb93a971b43b643641022e6 WatchSource:0}: Error finding container 87f858e11df3115ce1902fff1c330116e4393977edb93a971b43b643641022e6: Status 404 returned error can't find the container with id 87f858e11df3115ce1902fff1c330116e4393977edb93a971b43b643641022e6 Jul 31 16:47:01.742076 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:47:01.742059 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e837526304cd459e1a47dbb46a371da.slice/crio-ad29f1cd4364efcc88837c8ef7cf74e72f2f143b53a675da7a81cd08ed3268e4 WatchSource:0}: Error finding container ad29f1cd4364efcc88837c8ef7cf74e72f2f143b53a675da7a81cd08ed3268e4: Status 404 returned error can't find the container with id ad29f1cd4364efcc88837c8ef7cf74e72f2f143b53a675da7a81cd08ed3268e4 Jul 31 16:47:01.746927 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.746913 2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 16:47:01.748274 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748253 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be2ba90e-7372-4e7f-bed4-ad0616ea12fd-tmp-dir\") pod \"node-resolver-v6vm6\" (UID: \"be2ba90e-7372-4e7f-bed4-ad0616ea12fd\") " pod="openshift-dns/node-resolver-v6vm6" Jul 31 16:47:01.748370 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748286 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-var-lib-openvswitch\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.748370 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748303 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s92st\" (UniqueName: \"kubernetes.io/projected/edb94d9c-3df8-4c0c-bba9-92f25716db88-kube-api-access-s92st\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.748370 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748317 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptdg5\" (UniqueName: \"kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5\") pod \"network-check-target-rdsbm\" (UID: \"c4753a62-82e4-4683-a90d-46ead858670b\") " pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:01.748370 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748362 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b8937e2d-a751-457b-946d-3cb74eb3e2a2-serviceca\") pod \"node-ca-ngdrm\" (UID: \"b8937e2d-a751-457b-946d-3cb74eb3e2a2\") " pod="openshift-image-registry/node-ca-ngdrm" Jul 31 16:47:01.748644 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748397 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/756d5c76-69ba-4b10-ae30-50b0ca29aa13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.748644 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748423 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-os-release\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.748644 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748482 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-run-netns\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.748644 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748520 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-run-ovn-kubernetes\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.748644 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748538 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-var-lib-openvswitch\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.748644 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748555 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/756d5c76-69ba-4b10-ae30-50b0ca29aa13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.748644 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748583 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-system-cni-dir\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.748644 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748580 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-run-netns\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.748644 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748585 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-run-ovn-kubernetes\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.748644 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748612 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-etc-kubernetes\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.748644 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748638 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03511f12-e0b8-4d9d-8470-032ef0530e8a-host-slash\") pod \"iptables-alerter-q824w\" (UID: \"03511f12-e0b8-4d9d-8470-032ef0530e8a\") " pod="openshift-network-operator/iptables-alerter-q824w" Jul 31 16:47:01.749183 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748660 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret\") pod \"global-pull-secret-syncer-s2csx\" (UID: \"7528c182-537a-43db-b0bd-5633029d814c\") " pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:01.749183 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748696 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-registration-dir\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.749183 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748722 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs\") pod \"network-metrics-daemon-fmdcm\" (UID: \"74210898-48a8-42d3-a8f1-25708d2719cb\") " pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:01.749183 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748746 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sdhb\" (UniqueName: \"kubernetes.io/projected/74210898-48a8-42d3-a8f1-25708d2719cb-kube-api-access-6sdhb\") pod \"network-metrics-daemon-fmdcm\" (UID: \"74210898-48a8-42d3-a8f1-25708d2719cb\") " pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:01.749183 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748770 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-modprobe-d\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.749183 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748792 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-sys\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.749183 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748806 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-lib-modules\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.749183 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748823 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90971cfa-48b0-45cd-851f-76c4460175ea-etc-tuned\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.749183 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748846 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0fbfbd18-4216-4c43-8309-b97da0fe3ac2-agent-certs\") pod \"konnectivity-agent-hc82h\" (UID: \"0fbfbd18-4216-4c43-8309-b97da0fe3ac2\") " pod="kube-system/konnectivity-agent-hc82h" Jul 31 16:47:01.749183 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748956 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-var-lib-cni-multus\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.749183 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.748991 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.749183 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749013 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-sys-fs\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.749183 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749034 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-sysctl-conf\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.749183 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749053 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-host\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.749183 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749077 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-slash\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.749183 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749084 2586 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 31 16:47:01.749183 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749099 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-run-systemd\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.749964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749124 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.749964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749142 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-slash\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.749964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749150 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0fbfbd18-4216-4c43-8309-b97da0fe3ac2-konnectivity-ca\") pod \"konnectivity-agent-hc82h\" (UID: \"0fbfbd18-4216-4c43-8309-b97da0fe3ac2\") " pod="kube-system/konnectivity-agent-hc82h" Jul 31 16:47:01.749964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749176 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/756d5c76-69ba-4b10-ae30-50b0ca29aa13-os-release\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.749964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749224 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-run-systemd\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.749964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749226 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.749964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749266 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-multus-daemon-config\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.749964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749341 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8tlw\" (UniqueName: \"kubernetes.io/projected/03511f12-e0b8-4d9d-8470-032ef0530e8a-kube-api-access-k8tlw\") pod \"iptables-alerter-q824w\" (UID: \"03511f12-e0b8-4d9d-8470-032ef0530e8a\") " pod="openshift-network-operator/iptables-alerter-q824w" Jul 31 16:47:01.749964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749365 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-kubernetes\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.749964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749405 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-var-lib-kubelet\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.749964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749430 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-cni-netd\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.749964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749473 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/756d5c76-69ba-4b10-ae30-50b0ca29aa13-cnibin\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.749964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749495 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/756d5c76-69ba-4b10-ae30-50b0ca29aa13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.749964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749551 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-multus-cni-dir\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.749964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749575 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-cni-binary-copy\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.749964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749599 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-run-netns\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.749964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749624 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-cni-bin\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.751165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749648 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/edb94d9c-3df8-4c0c-bba9-92f25716db88-ovn-node-metrics-cert\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.751165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749675 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/edb94d9c-3df8-4c0c-bba9-92f25716db88-ovnkube-script-lib\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.751165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749699 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/edb94d9c-3df8-4c0c-bba9-92f25716db88-ovnkube-config\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.751165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749730 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/756d5c76-69ba-4b10-ae30-50b0ca29aa13-cni-binary-copy\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.751165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749756 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8smp6\" (UniqueName: \"kubernetes.io/projected/756d5c76-69ba-4b10-ae30-50b0ca29aa13-kube-api-access-8smp6\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.751165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749772 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0fbfbd18-4216-4c43-8309-b97da0fe3ac2-konnectivity-ca\") pod \"konnectivity-agent-hc82h\" (UID: \"0fbfbd18-4216-4c43-8309-b97da0fe3ac2\") " pod="kube-system/konnectivity-agent-hc82h" Jul 31 16:47:01.751165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749833 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-cni-netd\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.751165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749859 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-multus-socket-dir-parent\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.751165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749888 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-multus-conf-dir\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.751165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749914 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hffh\" (UniqueName: \"kubernetes.io/projected/be2ba90e-7372-4e7f-bed4-ad0616ea12fd-kube-api-access-9hffh\") pod \"node-resolver-v6vm6\" (UID: \"be2ba90e-7372-4e7f-bed4-ad0616ea12fd\") " pod="openshift-dns/node-resolver-v6vm6" Jul 31 16:47:01.751165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749938 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-systemd\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.751165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.749940 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-cni-bin\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.751165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750118 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-var-lib-kubelet\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.751165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750145 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-hostroot\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.751165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750202 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03511f12-e0b8-4d9d-8470-032ef0530e8a-iptables-alerter-script\") pod \"iptables-alerter-q824w\" (UID: \"03511f12-e0b8-4d9d-8470-032ef0530e8a\") " pod="openshift-network-operator/iptables-alerter-q824w" Jul 31 16:47:01.751165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750224 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88pvg\" (UniqueName: \"kubernetes.io/projected/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-kube-api-access-88pvg\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.751165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750246 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-systemd-units\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.752032 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750278 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-etc-openvswitch\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.752032 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750299 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-cnibin\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.752032 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750318 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-etc-selinux\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.752032 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750339 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-sysconfig\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.752032 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750361 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-sysctl-d\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.752032 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750383 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtf8r\" (UniqueName: \"kubernetes.io/projected/90971cfa-48b0-45cd-851f-76c4460175ea-kube-api-access-wtf8r\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.752032 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750409 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-run-ovn\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.752032 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750432 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-run-k8s-cni-cncf-io\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.752032 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750469 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-run\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.752032 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750483 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/edb94d9c-3df8-4c0c-bba9-92f25716db88-ovnkube-config\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.752032 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750492 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-log-socket\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.752032 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750518 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/756d5c76-69ba-4b10-ae30-50b0ca29aa13-system-cni-dir\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.752032 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750488 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/edb94d9c-3df8-4c0c-bba9-92f25716db88-ovnkube-script-lib\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.752032 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750542 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-run-multus-certs\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.752032 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750557 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-etc-openvswitch\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.752032 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750579 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-run-ovn\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.752032 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750590 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-log-socket\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.752888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750627 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-systemd-units\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.752888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750650 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-run-openvswitch\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.752888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750681 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-run-openvswitch\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.752888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750689 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/edb94d9c-3df8-4c0c-bba9-92f25716db88-env-overrides\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.752888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750739 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7528c182-537a-43db-b0bd-5633029d814c-kubelet-config\") pod \"global-pull-secret-syncer-s2csx\" (UID: \"7528c182-537a-43db-b0bd-5633029d814c\") " pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:01.752888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750771 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7528c182-537a-43db-b0bd-5633029d814c-dbus\") pod \"global-pull-secret-syncer-s2csx\" (UID: \"7528c182-537a-43db-b0bd-5633029d814c\") " pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:01.752888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750796 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-socket-dir\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.752888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750819 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-device-dir\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.752888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750840 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90971cfa-48b0-45cd-851f-76c4460175ea-tmp\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.752888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750868 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-kubelet\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.752888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750924 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-node-log\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.752888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750971 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8937e2d-a751-457b-946d-3cb74eb3e2a2-host\") pod \"node-ca-ngdrm\" (UID: \"b8937e2d-a751-457b-946d-3cb74eb3e2a2\") " pod="openshift-image-registry/node-ca-ngdrm" Jul 31 16:47:01.752888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.750995 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bswt\" (UniqueName: \"kubernetes.io/projected/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-kube-api-access-9bswt\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.752888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.751040 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-host-kubelet\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.752888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.751048 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/edb94d9c-3df8-4c0c-bba9-92f25716db88-node-log\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.752888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.751089 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be2ba90e-7372-4e7f-bed4-ad0616ea12fd-hosts-file\") pod \"node-resolver-v6vm6\" (UID: \"be2ba90e-7372-4e7f-bed4-ad0616ea12fd\") " pod="openshift-dns/node-resolver-v6vm6" Jul 31 16:47:01.752888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.751109 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/edb94d9c-3df8-4c0c-bba9-92f25716db88-env-overrides\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.753560 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.751131 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vd24\" (UniqueName: \"kubernetes.io/projected/b8937e2d-a751-457b-946d-3cb74eb3e2a2-kube-api-access-5vd24\") pod \"node-ca-ngdrm\" (UID: \"b8937e2d-a751-457b-946d-3cb74eb3e2a2\") " pod="openshift-image-registry/node-ca-ngdrm" Jul 31 16:47:01.753560 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.751160 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-var-lib-cni-bin\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.753560 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.753210 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0fbfbd18-4216-4c43-8309-b97da0fe3ac2-agent-certs\") pod \"konnectivity-agent-hc82h\" (UID: \"0fbfbd18-4216-4c43-8309-b97da0fe3ac2\") " pod="kube-system/konnectivity-agent-hc82h" Jul 31 16:47:01.753560 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.753213 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/edb94d9c-3df8-4c0c-bba9-92f25716db88-ovn-node-metrics-cert\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.756188 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:01.756171 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 16:47:01.756262 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:01.756193 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 16:47:01.756262 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:01.756205 2586 projected.go:196] Error preparing data for projected volume kube-api-access-ptdg5 for pod openshift-network-diagnostics/network-check-target-rdsbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 16:47:01.756358 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:01.756264 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5 podName:c4753a62-82e4-4683-a90d-46ead858670b nodeName:}" failed. No retries permitted until 2026-07-31 16:47:02.256249657 +0000 UTC m=+2.027279947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ptdg5" (UniqueName: "kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5") pod "network-check-target-rdsbm" (UID: "c4753a62-82e4-4683-a90d-46ead858670b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 16:47:01.758704 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.758681 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s92st\" (UniqueName: \"kubernetes.io/projected/edb94d9c-3df8-4c0c-bba9-92f25716db88-kube-api-access-s92st\") pod \"ovnkube-node-fn5jp\" (UID: \"edb94d9c-3df8-4c0c-bba9-92f25716db88\") " pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.770843 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.770827 2586 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 16:47:01.852354 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852326 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs\") pod \"network-metrics-daemon-fmdcm\" (UID: \"74210898-48a8-42d3-a8f1-25708d2719cb\") " pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:01.852354 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852357 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sdhb\" (UniqueName: \"kubernetes.io/projected/74210898-48a8-42d3-a8f1-25708d2719cb-kube-api-access-6sdhb\") pod \"network-metrics-daemon-fmdcm\" (UID: \"74210898-48a8-42d3-a8f1-25708d2719cb\") " pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:01.852603 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852375 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-modprobe-d\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.852603 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852391 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-sys\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.852603 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852429 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-lib-modules\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.852603 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852486 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90971cfa-48b0-45cd-851f-76c4460175ea-etc-tuned\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.852603 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852512 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-var-lib-cni-multus\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.852603 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852523 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-modprobe-d\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.852603 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852536 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.852603 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:01.852552 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 16:47:01.852603 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852559 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-sys-fs\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.852603 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852569 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-sys\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.852603 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852582 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-sysctl-conf\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.853144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852605 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-lib-modules\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.853144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852606 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-var-lib-cni-multus\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.853144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852628 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.853144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852613 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-sys-fs\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.853144 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:01.852615 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs podName:74210898-48a8-42d3-a8f1-25708d2719cb nodeName:}" failed. No retries permitted until 2026-07-31 16:47:02.352596879 +0000 UTC m=+2.123627178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs") pod "network-metrics-daemon-fmdcm" (UID: "74210898-48a8-42d3-a8f1-25708d2719cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 16:47:01.853144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852668 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-host\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.853144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852708 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/756d5c76-69ba-4b10-ae30-50b0ca29aa13-os-release\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.853144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852715 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-sysctl-conf\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.853144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852715 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-host\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.853144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852729 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-multus-daemon-config\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.853144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852762 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8tlw\" (UniqueName: \"kubernetes.io/projected/03511f12-e0b8-4d9d-8470-032ef0530e8a-kube-api-access-k8tlw\") pod \"iptables-alerter-q824w\" (UID: \"03511f12-e0b8-4d9d-8470-032ef0530e8a\") " pod="openshift-network-operator/iptables-alerter-q824w" Jul 31 16:47:01.853144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852788 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-kubernetes\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.853144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852813 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-var-lib-kubelet\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.853144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852789 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/756d5c76-69ba-4b10-ae30-50b0ca29aa13-os-release\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.853144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852841 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/756d5c76-69ba-4b10-ae30-50b0ca29aa13-cnibin\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.853144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852865 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/756d5c76-69ba-4b10-ae30-50b0ca29aa13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.853912 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852883 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-var-lib-kubelet\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.853912 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852887 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-multus-cni-dir\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.853912 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852934 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-cni-binary-copy\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.853912 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852898 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-kubernetes\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.853912 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852958 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-run-netns\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.853912 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852963 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/756d5c76-69ba-4b10-ae30-50b0ca29aa13-cnibin\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.853912 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.852988 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/756d5c76-69ba-4b10-ae30-50b0ca29aa13-cni-binary-copy\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.853912 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853008 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-run-netns\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.853912 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853015 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8smp6\" (UniqueName: \"kubernetes.io/projected/756d5c76-69ba-4b10-ae30-50b0ca29aa13-kube-api-access-8smp6\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.853912 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853042 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-multus-socket-dir-parent\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.853912 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853066 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-multus-conf-dir\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.853912 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853075 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-multus-cni-dir\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.853912 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853089 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hffh\" (UniqueName: \"kubernetes.io/projected/be2ba90e-7372-4e7f-bed4-ad0616ea12fd-kube-api-access-9hffh\") pod \"node-resolver-v6vm6\" (UID: \"be2ba90e-7372-4e7f-bed4-ad0616ea12fd\") " pod="openshift-dns/node-resolver-v6vm6" Jul 31 16:47:01.853912 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853113 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-systemd\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.853912 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853136 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-var-lib-kubelet\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.853912 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853157 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-hostroot\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.853912 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853181 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03511f12-e0b8-4d9d-8470-032ef0530e8a-iptables-alerter-script\") pod \"iptables-alerter-q824w\" (UID: \"03511f12-e0b8-4d9d-8470-032ef0530e8a\") " pod="openshift-network-operator/iptables-alerter-q824w" Jul 31 16:47:01.854631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853208 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88pvg\" (UniqueName: \"kubernetes.io/projected/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-kube-api-access-88pvg\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.854631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853234 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-cnibin\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.854631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853258 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-etc-selinux\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.854631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853280 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-sysconfig\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.854631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853286 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-multus-daemon-config\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.854631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853303 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-sysctl-d\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.854631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853322 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-var-lib-kubelet\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.854631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853338 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtf8r\" (UniqueName: \"kubernetes.io/projected/90971cfa-48b0-45cd-851f-76c4460175ea-kube-api-access-wtf8r\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.854631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853352 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-hostroot\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.854631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853367 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-run-k8s-cni-cncf-io\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.854631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853393 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-run\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.854631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853412 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-cni-binary-copy\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.854631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853419 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/756d5c76-69ba-4b10-ae30-50b0ca29aa13-system-cni-dir\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.854631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853438 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/756d5c76-69ba-4b10-ae30-50b0ca29aa13-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.854631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853474 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-run-multus-certs\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.854631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853499 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/756d5c76-69ba-4b10-ae30-50b0ca29aa13-cni-binary-copy\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.854631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853513 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-run-multus-certs\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853503 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7528c182-537a-43db-b0bd-5633029d814c-kubelet-config\") pod \"global-pull-secret-syncer-s2csx\" (UID: \"7528c182-537a-43db-b0bd-5633029d814c\") " pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853537 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7528c182-537a-43db-b0bd-5633029d814c-kubelet-config\") pod \"global-pull-secret-syncer-s2csx\" (UID: \"7528c182-537a-43db-b0bd-5633029d814c\") " pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853477 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/756d5c76-69ba-4b10-ae30-50b0ca29aa13-system-cni-dir\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853554 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-run-k8s-cni-cncf-io\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853369 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-multus-conf-dir\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853547 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7528c182-537a-43db-b0bd-5633029d814c-dbus\") pod \"global-pull-secret-syncer-s2csx\" (UID: \"7528c182-537a-43db-b0bd-5633029d814c\") " pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853561 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-cnibin\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853566 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-sysctl-d\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853590 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-run\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853604 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7528c182-537a-43db-b0bd-5633029d814c-dbus\") pod \"global-pull-secret-syncer-s2csx\" (UID: \"7528c182-537a-43db-b0bd-5633029d814c\") " pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853609 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-systemd\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853641 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-etc-selinux\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853652 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90971cfa-48b0-45cd-851f-76c4460175ea-etc-sysconfig\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853648 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-socket-dir\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853679 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-device-dir\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853701 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90971cfa-48b0-45cd-851f-76c4460175ea-tmp\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853725 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-multus-socket-dir-parent\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.855086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853726 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8937e2d-a751-457b-946d-3cb74eb3e2a2-host\") pod \"node-ca-ngdrm\" (UID: \"b8937e2d-a751-457b-946d-3cb74eb3e2a2\") " pod="openshift-image-registry/node-ca-ngdrm" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853758 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-socket-dir\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853763 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b8937e2d-a751-457b-946d-3cb74eb3e2a2-host\") pod \"node-ca-ngdrm\" (UID: \"b8937e2d-a751-457b-946d-3cb74eb3e2a2\") " pod="openshift-image-registry/node-ca-ngdrm" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853763 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bswt\" (UniqueName: \"kubernetes.io/projected/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-kube-api-access-9bswt\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853805 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be2ba90e-7372-4e7f-bed4-ad0616ea12fd-hosts-file\") pod \"node-resolver-v6vm6\" (UID: \"be2ba90e-7372-4e7f-bed4-ad0616ea12fd\") " pod="openshift-dns/node-resolver-v6vm6" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853797 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-device-dir\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853834 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vd24\" (UniqueName: \"kubernetes.io/projected/b8937e2d-a751-457b-946d-3cb74eb3e2a2-kube-api-access-5vd24\") pod \"node-ca-ngdrm\" (UID: \"b8937e2d-a751-457b-946d-3cb74eb3e2a2\") " pod="openshift-image-registry/node-ca-ngdrm" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853857 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-var-lib-cni-bin\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853868 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/be2ba90e-7372-4e7f-bed4-ad0616ea12fd-hosts-file\") pod \"node-resolver-v6vm6\" (UID: \"be2ba90e-7372-4e7f-bed4-ad0616ea12fd\") " pod="openshift-dns/node-resolver-v6vm6" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853879 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be2ba90e-7372-4e7f-bed4-ad0616ea12fd-tmp-dir\") pod \"node-resolver-v6vm6\" (UID: \"be2ba90e-7372-4e7f-bed4-ad0616ea12fd\") " pod="openshift-dns/node-resolver-v6vm6" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853939 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b8937e2d-a751-457b-946d-3cb74eb3e2a2-serviceca\") pod \"node-ca-ngdrm\" (UID: \"b8937e2d-a751-457b-946d-3cb74eb3e2a2\") " pod="openshift-image-registry/node-ca-ngdrm" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.853987 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/756d5c76-69ba-4b10-ae30-50b0ca29aa13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854008 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-host-var-lib-cni-bin\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854013 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-os-release\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854064 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/756d5c76-69ba-4b10-ae30-50b0ca29aa13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854079 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-os-release\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854090 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-system-cni-dir\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854112 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-etc-kubernetes\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.855591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854113 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03511f12-e0b8-4d9d-8470-032ef0530e8a-iptables-alerter-script\") pod \"iptables-alerter-q824w\" (UID: \"03511f12-e0b8-4d9d-8470-032ef0530e8a\") " pod="openshift-network-operator/iptables-alerter-q824w" Jul 31 16:47:01.856118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854134 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03511f12-e0b8-4d9d-8470-032ef0530e8a-host-slash\") pod \"iptables-alerter-q824w\" (UID: \"03511f12-e0b8-4d9d-8470-032ef0530e8a\") " pod="openshift-network-operator/iptables-alerter-q824w" Jul 31 16:47:01.856118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854158 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret\") pod \"global-pull-secret-syncer-s2csx\" (UID: \"7528c182-537a-43db-b0bd-5633029d814c\") " pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:01.856118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854166 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-system-cni-dir\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.856118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854183 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-registration-dir\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.856118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854184 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be2ba90e-7372-4e7f-bed4-ad0616ea12fd-tmp-dir\") pod \"node-resolver-v6vm6\" (UID: \"be2ba90e-7372-4e7f-bed4-ad0616ea12fd\") " pod="openshift-dns/node-resolver-v6vm6" Jul 31 16:47:01.856118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854230 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-etc-kubernetes\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.856118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854252 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/756d5c76-69ba-4b10-ae30-50b0ca29aa13-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.856118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854287 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-registration-dir\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.856118 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:01.854303 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 16:47:01.856118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854310 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03511f12-e0b8-4d9d-8470-032ef0530e8a-host-slash\") pod \"iptables-alerter-q824w\" (UID: \"03511f12-e0b8-4d9d-8470-032ef0530e8a\") " pod="openshift-network-operator/iptables-alerter-q824w" Jul 31 16:47:01.856118 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:01.854345 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret podName:7528c182-537a-43db-b0bd-5633029d814c nodeName:}" failed. No retries permitted until 2026-07-31 16:47:02.354331403 +0000 UTC m=+2.125361690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret") pod "global-pull-secret-syncer-s2csx" (UID: "7528c182-537a-43db-b0bd-5633029d814c") : object "kube-system"/"original-pull-secret" not registered Jul 31 16:47:01.856118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854437 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b8937e2d-a751-457b-946d-3cb74eb3e2a2-serviceca\") pod \"node-ca-ngdrm\" (UID: \"b8937e2d-a751-457b-946d-3cb74eb3e2a2\") " pod="openshift-image-registry/node-ca-ngdrm" Jul 31 16:47:01.856118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.854544 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/756d5c76-69ba-4b10-ae30-50b0ca29aa13-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.856118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.855005 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90971cfa-48b0-45cd-851f-76c4460175ea-etc-tuned\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.856118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.855593 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90971cfa-48b0-45cd-851f-76c4460175ea-tmp\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.867457 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.867428 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8tlw\" (UniqueName: \"kubernetes.io/projected/03511f12-e0b8-4d9d-8470-032ef0530e8a-kube-api-access-k8tlw\") pod \"iptables-alerter-q824w\" (UID: \"03511f12-e0b8-4d9d-8470-032ef0530e8a\") " pod="openshift-network-operator/iptables-alerter-q824w" Jul 31 16:47:01.870705 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.870669 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vd24\" (UniqueName: \"kubernetes.io/projected/b8937e2d-a751-457b-946d-3cb74eb3e2a2-kube-api-access-5vd24\") pod \"node-ca-ngdrm\" (UID: \"b8937e2d-a751-457b-946d-3cb74eb3e2a2\") " pod="openshift-image-registry/node-ca-ngdrm" Jul 31 16:47:01.871184 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.871161 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8smp6\" (UniqueName: \"kubernetes.io/projected/756d5c76-69ba-4b10-ae30-50b0ca29aa13-kube-api-access-8smp6\") pod \"multus-additional-cni-plugins-bd2mc\" (UID: \"756d5c76-69ba-4b10-ae30-50b0ca29aa13\") " pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.871863 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.871837 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sdhb\" (UniqueName: \"kubernetes.io/projected/74210898-48a8-42d3-a8f1-25708d2719cb-kube-api-access-6sdhb\") pod \"network-metrics-daemon-fmdcm\" (UID: \"74210898-48a8-42d3-a8f1-25708d2719cb\") " pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:01.872181 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.872163 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88pvg\" (UniqueName: \"kubernetes.io/projected/53f0e0c4-6deb-43f2-bcac-0a6adae62b9b-kube-api-access-88pvg\") pod \"aws-ebs-csi-driver-node-9mdxd\" (UID: \"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:01.872326 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.872308 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtf8r\" (UniqueName: \"kubernetes.io/projected/90971cfa-48b0-45cd-851f-76c4460175ea-kube-api-access-wtf8r\") pod \"tuned-sfjqm\" (UID: \"90971cfa-48b0-45cd-851f-76c4460175ea\") " pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:01.872754 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.872735 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hffh\" (UniqueName: \"kubernetes.io/projected/be2ba90e-7372-4e7f-bed4-ad0616ea12fd-kube-api-access-9hffh\") pod \"node-resolver-v6vm6\" (UID: \"be2ba90e-7372-4e7f-bed4-ad0616ea12fd\") " pod="openshift-dns/node-resolver-v6vm6" Jul 31 16:47:01.873918 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.873903 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bswt\" (UniqueName: \"kubernetes.io/projected/b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c-kube-api-access-9bswt\") pod \"multus-p886w\" (UID: \"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c\") " pod="openshift-multus/multus-p886w" Jul 31 16:47:01.915591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.915561 2586 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 16:47:01.963020 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.962944 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:01.972016 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:47:01.971993 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedb94d9c_3df8_4c0c_bba9_92f25716db88.slice/crio-68001e81eddb302dd9b8c015a40ae031441f79945454250b9bd9c6f58db1b2c7 WatchSource:0}: Error finding container 68001e81eddb302dd9b8c015a40ae031441f79945454250b9bd9c6f58db1b2c7: Status 404 returned error can't find the container with id 68001e81eddb302dd9b8c015a40ae031441f79945454250b9bd9c6f58db1b2c7 Jul 31 16:47:01.979103 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.979086 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bd2mc" Jul 31 16:47:01.986105 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:47:01.986076 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756d5c76_69ba_4b10_ae30_50b0ca29aa13.slice/crio-b7ff0f8e1d8c22921d48c81616bdafb55f8a14ca54900dde050cb6d956101f5e WatchSource:0}: Error finding container b7ff0f8e1d8c22921d48c81616bdafb55f8a14ca54900dde050cb6d956101f5e: Status 404 returned error can't find the container with id b7ff0f8e1d8c22921d48c81616bdafb55f8a14ca54900dde050cb6d956101f5e Jul 31 16:47:01.994887 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:01.994870 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hc82h" Jul 31 16:47:02.001488 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:47:02.001468 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fbfbd18_4216_4c43_8309_b97da0fe3ac2.slice/crio-0317889e4ca804c7cee21fdf42e15cb9279f4f83bd0a08ab2c3661a0e36cd15b WatchSource:0}: Error finding container 0317889e4ca804c7cee21fdf42e15cb9279f4f83bd0a08ab2c3661a0e36cd15b: Status 404 returned error can't find the container with id 0317889e4ca804c7cee21fdf42e15cb9279f4f83bd0a08ab2c3661a0e36cd15b Jul 31 16:47:02.007421 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.007404 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" Jul 31 16:47:02.013654 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:47:02.013626 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53f0e0c4_6deb_43f2_bcac_0a6adae62b9b.slice/crio-12a6616da79f6e678894e2c2a502877ab405c0ac2b17cf8e39ef1bb1b398907a WatchSource:0}: Error finding container 12a6616da79f6e678894e2c2a502877ab405c0ac2b17cf8e39ef1bb1b398907a: Status 404 returned error can't find the container with id 12a6616da79f6e678894e2c2a502877ab405c0ac2b17cf8e39ef1bb1b398907a Jul 31 16:47:02.024459 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.024433 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v6vm6" Jul 31 16:47:02.033566 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:47:02.033546 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2ba90e_7372_4e7f_bed4_ad0616ea12fd.slice/crio-ebdfff9655c812859d4912fb1b07f193feb80a68cfc5a36c1cf453536d8d5303 WatchSource:0}: Error finding container ebdfff9655c812859d4912fb1b07f193feb80a68cfc5a36c1cf453536d8d5303: Status 404 returned error can't find the container with id ebdfff9655c812859d4912fb1b07f193feb80a68cfc5a36c1cf453536d8d5303 Jul 31 16:47:02.053547 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.053528 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" Jul 31 16:47:02.059660 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:47:02.059638 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90971cfa_48b0_45cd_851f_76c4460175ea.slice/crio-a2f3c65957614c93b32b1ee7896486666305242d8b1aa6bd0bda5c96b2d3e4b7 WatchSource:0}: Error finding container a2f3c65957614c93b32b1ee7896486666305242d8b1aa6bd0bda5c96b2d3e4b7: Status 404 returned error can't find the container with id a2f3c65957614c93b32b1ee7896486666305242d8b1aa6bd0bda5c96b2d3e4b7 Jul 31 16:47:02.063530 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.063512 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ngdrm" Jul 31 16:47:02.070074 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.070057 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p886w" Jul 31 16:47:02.070264 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:47:02.070244 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8937e2d_a751_457b_946d_3cb74eb3e2a2.slice/crio-53d6d3830adf9aff9253290dbe9f1ed8f821dc299aa6d319e4eeb72c21995c37 WatchSource:0}: Error finding container 53d6d3830adf9aff9253290dbe9f1ed8f821dc299aa6d319e4eeb72c21995c37: Status 404 returned error can't find the container with id 53d6d3830adf9aff9253290dbe9f1ed8f821dc299aa6d319e4eeb72c21995c37 Jul 31 16:47:02.074295 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.074277 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q824w" Jul 31 16:47:02.077027 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:47:02.077008 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4f6ad55_a8ba_43fc_b3f2_aedde1e3392c.slice/crio-4162b649f8df4717c81928c859eea52679017011324b88b4b4f3750315c766df WatchSource:0}: Error finding container 4162b649f8df4717c81928c859eea52679017011324b88b4b4f3750315c766df: Status 404 returned error can't find the container with id 4162b649f8df4717c81928c859eea52679017011324b88b4b4f3750315c766df Jul 31 16:47:02.081272 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:47:02.081255 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03511f12_e0b8_4d9d_8470_032ef0530e8a.slice/crio-1be46063423c5be9c68d18571dc121cbf2bb12e67da6e3d34914a8e71d912038 WatchSource:0}: Error finding container 1be46063423c5be9c68d18571dc121cbf2bb12e67da6e3d34914a8e71d912038: Status 404 returned error can't find the container with id 1be46063423c5be9c68d18571dc121cbf2bb12e67da6e3d34914a8e71d912038 Jul 31 16:47:02.356782 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.356699 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptdg5\" (UniqueName: \"kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5\") pod \"network-check-target-rdsbm\" (UID: \"c4753a62-82e4-4683-a90d-46ead858670b\") " pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:02.356782 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.356735 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret\") pod \"global-pull-secret-syncer-s2csx\" (UID: \"7528c182-537a-43db-b0bd-5633029d814c\") " pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:02.356782 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.356765 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs\") pod \"network-metrics-daemon-fmdcm\" (UID: \"74210898-48a8-42d3-a8f1-25708d2719cb\") " pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:02.356974 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:02.356854 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 16:47:02.356974 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:02.356866 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 16:47:02.356974 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:02.356867 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 16:47:02.356974 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:02.356906 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret podName:7528c182-537a-43db-b0bd-5633029d814c nodeName:}" failed. No retries permitted until 2026-07-31 16:47:03.356891573 +0000 UTC m=+3.127921858 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret") pod "global-pull-secret-syncer-s2csx" (UID: "7528c182-537a-43db-b0bd-5633029d814c") : object "kube-system"/"original-pull-secret" not registered Jul 31 16:47:02.356974 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:02.356914 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 16:47:02.356974 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:02.356921 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs podName:74210898-48a8-42d3-a8f1-25708d2719cb nodeName:}" failed. No retries permitted until 2026-07-31 16:47:03.356915509 +0000 UTC m=+3.127945795 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs") pod "network-metrics-daemon-fmdcm" (UID: "74210898-48a8-42d3-a8f1-25708d2719cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 16:47:02.356974 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:02.356923 2586 projected.go:196] Error preparing data for projected volume kube-api-access-ptdg5 for pod openshift-network-diagnostics/network-check-target-rdsbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 16:47:02.356974 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:02.356957 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5 podName:c4753a62-82e4-4683-a90d-46ead858670b nodeName:}" failed. No retries permitted until 2026-07-31 16:47:03.356943023 +0000 UTC m=+3.127973311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptdg5" (UniqueName: "kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5") pod "network-check-target-rdsbm" (UID: "c4753a62-82e4-4683-a90d-46ead858670b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 16:47:02.701602 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.701325 2586 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 16:47:02.712093 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.711966 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 16:42:01 +0000 UTC" deadline="2028-02-09 13:47:08.91406123 +0000 UTC" Jul 31 16:47:02.712093 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.712028 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13389h0m6.202037031s" Jul 31 16:47:02.718438 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.717820 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:02.718438 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:02.717945 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:02.743033 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.742910 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hc82h" event={"ID":"0fbfbd18-4216-4c43-8309-b97da0fe3ac2","Type":"ContainerStarted","Data":"0317889e4ca804c7cee21fdf42e15cb9279f4f83bd0a08ab2c3661a0e36cd15b"} Jul 31 16:47:02.763727 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.763673 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bd2mc" event={"ID":"756d5c76-69ba-4b10-ae30-50b0ca29aa13","Type":"ContainerStarted","Data":"b7ff0f8e1d8c22921d48c81616bdafb55f8a14ca54900dde050cb6d956101f5e"} Jul 31 16:47:02.794245 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.794201 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" event={"ID":"edb94d9c-3df8-4c0c-bba9-92f25716db88","Type":"ContainerStarted","Data":"68001e81eddb302dd9b8c015a40ae031441f79945454250b9bd9c6f58db1b2c7"} Jul 31 16:47:02.816274 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.816235 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q824w" event={"ID":"03511f12-e0b8-4d9d-8470-032ef0530e8a","Type":"ContainerStarted","Data":"1be46063423c5be9c68d18571dc121cbf2bb12e67da6e3d34914a8e71d912038"} Jul 31 16:47:02.838763 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.838698 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-127.ec2.internal" event={"ID":"0e837526304cd459e1a47dbb46a371da","Type":"ContainerStarted","Data":"ad29f1cd4364efcc88837c8ef7cf74e72f2f143b53a675da7a81cd08ed3268e4"} Jul 31 16:47:02.845339 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.845301 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal" event={"ID":"a869829cad3bc273f8d256f5ab6e77c6","Type":"ContainerStarted","Data":"87f858e11df3115ce1902fff1c330116e4393977edb93a971b43b643641022e6"} Jul 31 16:47:02.856151 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.856116 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p886w" event={"ID":"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c","Type":"ContainerStarted","Data":"4162b649f8df4717c81928c859eea52679017011324b88b4b4f3750315c766df"} Jul 31 16:47:02.868268 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.868229 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ngdrm" event={"ID":"b8937e2d-a751-457b-946d-3cb74eb3e2a2","Type":"ContainerStarted","Data":"53d6d3830adf9aff9253290dbe9f1ed8f821dc299aa6d319e4eeb72c21995c37"} Jul 31 16:47:02.891865 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.891828 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" event={"ID":"90971cfa-48b0-45cd-851f-76c4460175ea","Type":"ContainerStarted","Data":"a2f3c65957614c93b32b1ee7896486666305242d8b1aa6bd0bda5c96b2d3e4b7"} Jul 31 16:47:02.916986 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.916617 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v6vm6" event={"ID":"be2ba90e-7372-4e7f-bed4-ad0616ea12fd","Type":"ContainerStarted","Data":"ebdfff9655c812859d4912fb1b07f193feb80a68cfc5a36c1cf453536d8d5303"} Jul 31 16:47:02.923969 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:02.923934 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" event={"ID":"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b","Type":"ContainerStarted","Data":"12a6616da79f6e678894e2c2a502877ab405c0ac2b17cf8e39ef1bb1b398907a"} Jul 31 16:47:03.369397 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:03.369356 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptdg5\" (UniqueName: \"kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5\") pod \"network-check-target-rdsbm\" (UID: \"c4753a62-82e4-4683-a90d-46ead858670b\") " pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:03.369587 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:03.369414 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret\") pod \"global-pull-secret-syncer-s2csx\" (UID: \"7528c182-537a-43db-b0bd-5633029d814c\") " pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:03.369587 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:03.369444 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs\") pod \"network-metrics-daemon-fmdcm\" (UID: \"74210898-48a8-42d3-a8f1-25708d2719cb\") " pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:03.369587 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:03.369584 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 16:47:03.369766 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:03.369647 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs podName:74210898-48a8-42d3-a8f1-25708d2719cb nodeName:}" failed. No retries permitted until 2026-07-31 16:47:05.369628282 +0000 UTC m=+5.140658573 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs") pod "network-metrics-daemon-fmdcm" (UID: "74210898-48a8-42d3-a8f1-25708d2719cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 16:47:03.369766 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:03.369733 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 16:47:03.369872 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:03.369780 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 16:47:03.369872 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:03.369793 2586 projected.go:196] Error preparing data for projected volume kube-api-access-ptdg5 for pod openshift-network-diagnostics/network-check-target-rdsbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 16:47:03.369872 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:03.369835 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5 podName:c4753a62-82e4-4683-a90d-46ead858670b nodeName:}" failed. No retries permitted until 2026-07-31 16:47:05.369820683 +0000 UTC m=+5.140850970 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptdg5" (UniqueName: "kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5") pod "network-check-target-rdsbm" (UID: "c4753a62-82e4-4683-a90d-46ead858670b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 16:47:03.370025 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:03.370010 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 16:47:03.370073 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:03.370047 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret podName:7528c182-537a-43db-b0bd-5633029d814c nodeName:}" failed. No retries permitted until 2026-07-31 16:47:05.370036147 +0000 UTC m=+5.141066438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret") pod "global-pull-secret-syncer-s2csx" (UID: "7528c182-537a-43db-b0bd-5633029d814c") : object "kube-system"/"original-pull-secret" not registered Jul 31 16:47:03.712334 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:03.712190 2586 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-30 16:42:01 +0000 UTC" deadline="2028-04-20 01:02:18.285541046 +0000 UTC" Jul 31 16:47:03.712334 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:03.712249 2586 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15080h15m14.573295377s" Jul 31 16:47:03.717929 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:03.717183 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:03.717929 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:03.717314 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmdcm" podUID="74210898-48a8-42d3-a8f1-25708d2719cb" Jul 31 16:47:03.717929 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:03.717789 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:03.717929 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:03.717882 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s2csx" podUID="7528c182-537a-43db-b0bd-5633029d814c" Jul 31 16:47:04.487924 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:04.487894 2586 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 31 16:47:04.719191 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:04.719162 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:04.719727 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:04.719285 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:05.390781 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:05.389911 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptdg5\" (UniqueName: \"kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5\") pod \"network-check-target-rdsbm\" (UID: \"c4753a62-82e4-4683-a90d-46ead858670b\") " pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:05.390781 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:05.390004 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret\") pod \"global-pull-secret-syncer-s2csx\" (UID: \"7528c182-537a-43db-b0bd-5633029d814c\") " pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:05.390781 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:05.390070 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs\") pod \"network-metrics-daemon-fmdcm\" (UID: \"74210898-48a8-42d3-a8f1-25708d2719cb\") " pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:05.390781 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:05.390200 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 16:47:05.390781 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:05.390261 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs podName:74210898-48a8-42d3-a8f1-25708d2719cb nodeName:}" failed. No retries permitted until 2026-07-31 16:47:09.390243083 +0000 UTC m=+9.161273375 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs") pod "network-metrics-daemon-fmdcm" (UID: "74210898-48a8-42d3-a8f1-25708d2719cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 16:47:05.390781 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:05.390670 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 16:47:05.390781 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:05.390689 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 16:47:05.390781 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:05.390702 2586 projected.go:196] Error preparing data for projected volume kube-api-access-ptdg5 for pod openshift-network-diagnostics/network-check-target-rdsbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 16:47:05.390781 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:05.390744 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5 podName:c4753a62-82e4-4683-a90d-46ead858670b nodeName:}" failed. No retries permitted until 2026-07-31 16:47:09.390729704 +0000 UTC m=+9.161760003 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptdg5" (UniqueName: "kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5") pod "network-check-target-rdsbm" (UID: "c4753a62-82e4-4683-a90d-46ead858670b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 16:47:05.390781 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:05.390792 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 16:47:05.391421 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:05.390849 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret podName:7528c182-537a-43db-b0bd-5633029d814c nodeName:}" failed. No retries permitted until 2026-07-31 16:47:09.390833461 +0000 UTC m=+9.161863747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret") pod "global-pull-secret-syncer-s2csx" (UID: "7528c182-537a-43db-b0bd-5633029d814c") : object "kube-system"/"original-pull-secret" not registered Jul 31 16:47:05.717419 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:05.717337 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:05.717590 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:05.717487 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s2csx" podUID="7528c182-537a-43db-b0bd-5633029d814c" Jul 31 16:47:05.717590 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:05.717549 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:05.717711 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:05.717688 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmdcm" podUID="74210898-48a8-42d3-a8f1-25708d2719cb" Jul 31 16:47:06.718264 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:06.717714 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:06.718264 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:06.717833 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:07.717205 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:07.717164 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:07.717397 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:07.717213 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:07.717397 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:07.717285 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmdcm" podUID="74210898-48a8-42d3-a8f1-25708d2719cb" Jul 31 16:47:07.717535 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:07.717426 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s2csx" podUID="7528c182-537a-43db-b0bd-5633029d814c" Jul 31 16:47:08.716782 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:08.716755 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:08.717216 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:08.716861 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:09.423144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:09.423104 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptdg5\" (UniqueName: \"kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5\") pod \"network-check-target-rdsbm\" (UID: \"c4753a62-82e4-4683-a90d-46ead858670b\") " pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:09.423315 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:09.423163 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret\") pod \"global-pull-secret-syncer-s2csx\" (UID: \"7528c182-537a-43db-b0bd-5633029d814c\") " pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:09.423315 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:09.423189 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs\") pod \"network-metrics-daemon-fmdcm\" (UID: \"74210898-48a8-42d3-a8f1-25708d2719cb\") " pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:09.423473 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:09.423352 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 16:47:09.423473 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:09.423417 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs podName:74210898-48a8-42d3-a8f1-25708d2719cb nodeName:}" failed. No retries permitted until 2026-07-31 16:47:17.42339825 +0000 UTC m=+17.194428553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs") pod "network-metrics-daemon-fmdcm" (UID: "74210898-48a8-42d3-a8f1-25708d2719cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 16:47:09.423862 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:09.423842 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 16:47:09.423983 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:09.423869 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 16:47:09.423983 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:09.423881 2586 projected.go:196] Error preparing data for projected volume kube-api-access-ptdg5 for pod openshift-network-diagnostics/network-check-target-rdsbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 16:47:09.423983 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:09.423926 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5 podName:c4753a62-82e4-4683-a90d-46ead858670b nodeName:}" failed. No retries permitted until 2026-07-31 16:47:17.423910802 +0000 UTC m=+17.194941090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptdg5" (UniqueName: "kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5") pod "network-check-target-rdsbm" (UID: "c4753a62-82e4-4683-a90d-46ead858670b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 16:47:09.423983 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:09.423983 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 16:47:09.424210 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:09.424026 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret podName:7528c182-537a-43db-b0bd-5633029d814c nodeName:}" failed. No retries permitted until 2026-07-31 16:47:17.424015165 +0000 UTC m=+17.195045454 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret") pod "global-pull-secret-syncer-s2csx" (UID: "7528c182-537a-43db-b0bd-5633029d814c") : object "kube-system"/"original-pull-secret" not registered Jul 31 16:47:09.717104 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:09.717028 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:09.717571 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:09.717041 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:09.717571 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:09.717174 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmdcm" podUID="74210898-48a8-42d3-a8f1-25708d2719cb" Jul 31 16:47:09.717571 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:09.717330 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s2csx" podUID="7528c182-537a-43db-b0bd-5633029d814c" Jul 31 16:47:10.719120 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:10.718328 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:10.723919 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:10.723550 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:11.717829 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:11.717795 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:11.717829 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:11.717822 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:11.718097 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:11.717931 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s2csx" podUID="7528c182-537a-43db-b0bd-5633029d814c" Jul 31 16:47:11.718325 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:11.718298 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmdcm" podUID="74210898-48a8-42d3-a8f1-25708d2719cb" Jul 31 16:47:12.717821 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:12.717785 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:12.718271 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:12.717928 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:13.716853 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:13.716825 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:13.716993 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:13.716932 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmdcm" podUID="74210898-48a8-42d3-a8f1-25708d2719cb" Jul 31 16:47:13.717030 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:13.716987 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:13.717085 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:13.717067 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s2csx" podUID="7528c182-537a-43db-b0bd-5633029d814c" Jul 31 16:47:14.717491 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:14.717443 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:14.717892 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:14.717561 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:15.717292 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:15.717253 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:15.717485 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:15.717397 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmdcm" podUID="74210898-48a8-42d3-a8f1-25708d2719cb" Jul 31 16:47:15.717485 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:15.717462 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:15.717884 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:15.717561 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s2csx" podUID="7528c182-537a-43db-b0bd-5633029d814c" Jul 31 16:47:16.716976 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:16.716943 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:16.717142 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:16.717072 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:17.488963 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:17.488914 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptdg5\" (UniqueName: \"kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5\") pod \"network-check-target-rdsbm\" (UID: \"c4753a62-82e4-4683-a90d-46ead858670b\") " pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:17.489383 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:17.488976 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret\") pod \"global-pull-secret-syncer-s2csx\" (UID: \"7528c182-537a-43db-b0bd-5633029d814c\") " pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:17.489383 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:17.489002 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs\") pod \"network-metrics-daemon-fmdcm\" (UID: \"74210898-48a8-42d3-a8f1-25708d2719cb\") " pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:17.489383 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:17.489082 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 16:47:17.489383 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:17.489095 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 16:47:17.489383 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:17.489107 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 16:47:17.489383 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:17.489119 2586 projected.go:196] Error preparing data for projected volume kube-api-access-ptdg5 for pod openshift-network-diagnostics/network-check-target-rdsbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 16:47:17.489383 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:17.489142 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 16:47:17.489383 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:17.489154 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs podName:74210898-48a8-42d3-a8f1-25708d2719cb nodeName:}" failed. No retries permitted until 2026-07-31 16:47:33.489135091 +0000 UTC m=+33.260165394 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs") pod "network-metrics-daemon-fmdcm" (UID: "74210898-48a8-42d3-a8f1-25708d2719cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 16:47:17.489383 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:17.489214 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5 podName:c4753a62-82e4-4683-a90d-46ead858670b nodeName:}" failed. No retries permitted until 2026-07-31 16:47:33.489193194 +0000 UTC m=+33.260223494 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptdg5" (UniqueName: "kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5") pod "network-check-target-rdsbm" (UID: "c4753a62-82e4-4683-a90d-46ead858670b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 16:47:17.489383 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:17.489238 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret podName:7528c182-537a-43db-b0bd-5633029d814c nodeName:}" failed. No retries permitted until 2026-07-31 16:47:33.489227748 +0000 UTC m=+33.260258035 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret") pod "global-pull-secret-syncer-s2csx" (UID: "7528c182-537a-43db-b0bd-5633029d814c") : object "kube-system"/"original-pull-secret" not registered Jul 31 16:47:17.717589 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:17.717554 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:17.717831 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:17.717554 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:17.717831 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:17.717685 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s2csx" podUID="7528c182-537a-43db-b0bd-5633029d814c" Jul 31 16:47:17.717831 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:17.717787 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmdcm" podUID="74210898-48a8-42d3-a8f1-25708d2719cb" Jul 31 16:47:18.717282 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:18.717246 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:18.717726 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:18.717434 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:19.716926 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:19.716836 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:19.716926 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:19.716882 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:19.717232 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:19.716995 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmdcm" podUID="74210898-48a8-42d3-a8f1-25708d2719cb" Jul 31 16:47:19.717232 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:19.717106 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s2csx" podUID="7528c182-537a-43db-b0bd-5633029d814c" Jul 31 16:47:20.717827 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:20.717793 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:20.718274 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:20.717909 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:21.716885 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:21.716858 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:21.717024 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:21.716886 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:21.717024 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:21.716996 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmdcm" podUID="74210898-48a8-42d3-a8f1-25708d2719cb" Jul 31 16:47:21.717146 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:21.717083 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s2csx" podUID="7528c182-537a-43db-b0bd-5633029d814c" Jul 31 16:47:21.981476 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:21.981206 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-127.ec2.internal" event={"ID":"0e837526304cd459e1a47dbb46a371da","Type":"ContainerStarted","Data":"217238c4376e40069f327db22bce99417c8c49241e1c4119b2f122e3bffcfe0a"} Jul 31 16:47:21.993576 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:21.993381 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p886w" event={"ID":"b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c","Type":"ContainerStarted","Data":"bebdb548fea7bc55f90edf319bef6eb8ae1c48be6d8087807a4ab6d25750b2d7"} Jul 31 16:47:22.007937 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:22.007898 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" event={"ID":"90971cfa-48b0-45cd-851f-76c4460175ea","Type":"ContainerStarted","Data":"14e309b598f571bde92d6d42405e79d0d75a73e3e9dfb538bca3db6136f64a85"} Jul 31 16:47:22.013902 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:22.013866 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" event={"ID":"edb94d9c-3df8-4c0c-bba9-92f25716db88","Type":"ContainerStarted","Data":"c9af8f9af0c704ac993f9cd984ec11d0372aef986400b2fcac0ba60adc94735f"} Jul 31 16:47:22.014490 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:22.014409 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p886w" podStartSLOduration=1.3342647269999999 podStartE2EDuration="21.014389184s" totalImagesPullingTime="19.680124457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 16:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:47:22.013752915 +0000 UTC m=+21.784783223" watchObservedRunningTime="2026-07-31 16:47:22.014389184 +0000 UTC m=+21.785419492" Jul 31 16:47:22.014872 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:22.014836 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-127.ec2.internal" podStartSLOduration=21.014819261 podStartE2EDuration="21.014819261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 16:47:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:47:21.99678123 +0000 UTC m=+21.767811539" watchObservedRunningTime="2026-07-31 16:47:22.014819261 +0000 UTC m=+21.785849570" Jul 31 16:47:22.031565 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:22.031422 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sfjqm" podStartSLOduration=1.394321462 podStartE2EDuration="21.031401707s" totalImagesPullingTime="19.637080245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 16:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:47:22.031305015 +0000 UTC m=+21.802335325" watchObservedRunningTime="2026-07-31 16:47:22.031401707 +0000 UTC m=+21.802432029" Jul 31 16:47:22.717870 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:22.717832 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:22.718056 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:22.717943 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:23.017936 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.017894 2586 generic.go:356] "Generic (PLEG): container finished" podID="a869829cad3bc273f8d256f5ab6e77c6" containerID="9f6a2e710e15c4517df50d9c59ed6a082f6c077ac7f7ebef7c1a5656875c65f0" exitCode=0 Jul 31 16:47:23.018808 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.017985 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal" event={"ID":"a869829cad3bc273f8d256f5ab6e77c6","Type":"ContainerDied","Data":"9f6a2e710e15c4517df50d9c59ed6a082f6c077ac7f7ebef7c1a5656875c65f0"} Jul 31 16:47:23.020186 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.020157 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ngdrm" event={"ID":"b8937e2d-a751-457b-946d-3cb74eb3e2a2","Type":"ContainerStarted","Data":"460e11ac397cfd1b70c50e916f2827c3bed8716f55992c26defbff577a4ea8ae"} Jul 31 16:47:23.021687 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.021639 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v6vm6" event={"ID":"be2ba90e-7372-4e7f-bed4-ad0616ea12fd","Type":"ContainerStarted","Data":"a1add9bb1432960436600201e604ad385ed2b8655f7b246ba19a76659d195eae"} Jul 31 16:47:23.023180 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.023151 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" event={"ID":"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b","Type":"ContainerStarted","Data":"f70d0aadefc1594e178d32bcc9efebe16e7246b8050c096fab53222416172c73"} Jul 31 16:47:23.024556 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.024531 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hc82h" event={"ID":"0fbfbd18-4216-4c43-8309-b97da0fe3ac2","Type":"ContainerStarted","Data":"0351b2d02a9e0ba7d2a7884da7cb474a74cd30c74304b47b77643a6f5fe8ea13"} Jul 31 16:47:23.026121 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.026099 2586 generic.go:356] "Generic (PLEG): container finished" podID="756d5c76-69ba-4b10-ae30-50b0ca29aa13" containerID="cc9ddba6461eef72e0e0ce8818ae57f387c178913b028b023b6d617c7b142a34" exitCode=0 Jul 31 16:47:23.026215 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.026173 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bd2mc" event={"ID":"756d5c76-69ba-4b10-ae30-50b0ca29aa13","Type":"ContainerDied","Data":"cc9ddba6461eef72e0e0ce8818ae57f387c178913b028b023b6d617c7b142a34"} Jul 31 16:47:23.029416 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.029392 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" event={"ID":"edb94d9c-3df8-4c0c-bba9-92f25716db88","Type":"ContainerStarted","Data":"d5ccd447275de3bd77d9a2f75f4ef06c2abb19cecdbda5384d31ab74b38d1929"} Jul 31 16:47:23.029506 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.029492 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" event={"ID":"edb94d9c-3df8-4c0c-bba9-92f25716db88","Type":"ContainerStarted","Data":"5dc07df0b60955c7cfed8936975364159b5597def37ac00f05e81788b725d76c"} Jul 31 16:47:23.029579 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.029545 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" event={"ID":"edb94d9c-3df8-4c0c-bba9-92f25716db88","Type":"ContainerStarted","Data":"e2529d96d8f0bd94dfc9e73069ee1edcfdb7b144301ea6b84cc9dfda755854e4"} Jul 31 16:47:23.029636 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.029593 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" event={"ID":"edb94d9c-3df8-4c0c-bba9-92f25716db88","Type":"ContainerStarted","Data":"ae852569a5f75e72fdb160a9e0f1c9c3ed104ed7c829468109170600384e9784"} Jul 31 16:47:23.029696 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.029638 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" event={"ID":"edb94d9c-3df8-4c0c-bba9-92f25716db88","Type":"ContainerStarted","Data":"ed28ecf65f4f7b129b0fedf8886e53d7b6d194f1c9490416771433cbaf8225d2"} Jul 31 16:47:23.071936 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.071696 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hc82h" podStartSLOduration=7.238267584 podStartE2EDuration="23.071676687s" totalImagesPullingTime="15.833409103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:47:23.071129874 +0000 UTC m=+22.842160184" watchObservedRunningTime="2026-07-31 16:47:23.071676687 +0000 UTC m=+22.842706997" Jul 31 16:47:23.087661 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.087614 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v6vm6" podStartSLOduration=6.286371909 podStartE2EDuration="22.087596234s" totalImagesPullingTime="15.801224325s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 16:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:47:23.0870789 +0000 UTC m=+22.858109208" watchObservedRunningTime="2026-07-31 16:47:23.087596234 +0000 UTC m=+22.858626542" Jul 31 16:47:23.101938 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.101892 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ngdrm" podStartSLOduration=2.4755187 podStartE2EDuration="22.101875997s" totalImagesPullingTime="19.626357297s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 16:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:47:23.101487052 +0000 UTC m=+22.872517356" watchObservedRunningTime="2026-07-31 16:47:23.101875997 +0000 UTC m=+22.872906305" Jul 31 16:47:23.657513 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.657490 2586 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 31 16:47:23.711089 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.710988 2586 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-31T16:47:23.657505541Z","UUID":"f3359046-1403-4be2-9189-7e86a86c7933","Handler":null,"Name":"","Endpoint":""} Jul 31 16:47:23.712667 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.712649 2586 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 31 16:47:23.712780 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.712682 2586 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 31 16:47:23.717398 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.717376 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:23.717571 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:23.717398 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:23.717571 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:23.717489 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmdcm" podUID="74210898-48a8-42d3-a8f1-25708d2719cb" Jul 31 16:47:23.717687 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:23.717629 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s2csx" podUID="7528c182-537a-43db-b0bd-5633029d814c" Jul 31 16:47:24.034547 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:24.034465 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" event={"ID":"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b","Type":"ContainerStarted","Data":"44adca635eccc12edf27ad700aa27dbadd5bb8a0423809b20eef364863cbb9a5"} Jul 31 16:47:24.036203 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:24.036175 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q824w" event={"ID":"03511f12-e0b8-4d9d-8470-032ef0530e8a","Type":"ContainerStarted","Data":"5dc3c317709687f08d2aa63173d401f6c700fa6925ace1dbe76d29ded3a03089"} Jul 31 16:47:24.041216 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:24.041186 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal" event={"ID":"a869829cad3bc273f8d256f5ab6e77c6","Type":"ContainerStarted","Data":"59217f0b769bb6b5f1ea28138300fbce9442a2400fd78c7ee618485c078ad75b"} Jul 31 16:47:24.053964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:24.053916 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q824w" podStartSLOduration=3.414758258 podStartE2EDuration="23.053903151s" totalImagesPullingTime="19.639144893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 16:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:47:24.053700079 +0000 UTC m=+23.824730388" watchObservedRunningTime="2026-07-31 16:47:24.053903151 +0000 UTC m=+23.824933458" Jul 31 16:47:24.717139 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:24.717104 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:24.717352 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:24.717239 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:25.047176 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:25.047122 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" event={"ID":"edb94d9c-3df8-4c0c-bba9-92f25716db88","Type":"ContainerStarted","Data":"f8bc1b7cd411b8bf4a1263ac3b69f62ada5215adeec09c3a528e83d5ad202840"} Jul 31 16:47:25.717257 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:25.717227 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:25.717410 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:25.717243 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:25.717410 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:25.717349 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmdcm" podUID="74210898-48a8-42d3-a8f1-25708d2719cb" Jul 31 16:47:25.717410 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:25.717386 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s2csx" podUID="7528c182-537a-43db-b0bd-5633029d814c" Jul 31 16:47:26.051752 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:26.051672 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" event={"ID":"53f0e0c4-6deb-43f2-bcac-0a6adae62b9b","Type":"ContainerStarted","Data":"da908819fb265dfdbce764ecae83fc7430d6dc7a5f99e89bdaa323f2446dcfb0"} Jul 31 16:47:26.071175 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:26.071134 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-127.ec2.internal" podStartSLOduration=25.071117734 podStartE2EDuration="25.071117734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 16:47:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:47:24.068467006 +0000 UTC m=+23.839497315" watchObservedRunningTime="2026-07-31 16:47:26.071117734 +0000 UTC m=+25.842148042" Jul 31 16:47:26.071647 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:26.071624 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9mdxd" podStartSLOduration=2.61253472 podStartE2EDuration="25.071619501s" totalImagesPullingTime="22.459084781s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 16:47:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:47:26.070965521 +0000 UTC m=+25.841995830" watchObservedRunningTime="2026-07-31 16:47:26.071619501 +0000 UTC m=+25.842649830" Jul 31 16:47:26.717285 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:26.717254 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:26.717493 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:26.717394 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:26.760182 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:26.760148 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hc82h" Jul 31 16:47:26.760787 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:26.760768 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hc82h" Jul 31 16:47:27.054783 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:27.054695 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hc82h" Jul 31 16:47:27.055836 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:27.055811 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hc82h" Jul 31 16:47:27.717639 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:27.717601 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:27.717639 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:27.717633 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:27.717873 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:27.717728 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmdcm" podUID="74210898-48a8-42d3-a8f1-25708d2719cb" Jul 31 16:47:27.717873 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:27.717858 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s2csx" podUID="7528c182-537a-43db-b0bd-5633029d814c" Jul 31 16:47:28.717179 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:28.717026 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:28.717597 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:28.717276 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:29.060487 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:29.060456 2586 generic.go:356] "Generic (PLEG): container finished" podID="756d5c76-69ba-4b10-ae30-50b0ca29aa13" containerID="88afa400d8f7eecf6dd8b56f96bf04c8cc0951c399e15614c7340daa92767856" exitCode=0 Jul 31 16:47:29.060601 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:29.060538 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bd2mc" event={"ID":"756d5c76-69ba-4b10-ae30-50b0ca29aa13","Type":"ContainerDied","Data":"88afa400d8f7eecf6dd8b56f96bf04c8cc0951c399e15614c7340daa92767856"} Jul 31 16:47:29.065165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:29.065138 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" event={"ID":"edb94d9c-3df8-4c0c-bba9-92f25716db88","Type":"ContainerStarted","Data":"997a8ef1033f31e72f5ad0321842edb16392d86f9d27a95d968ef0fe9ed22089"} Jul 31 16:47:29.111799 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:29.111713 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" podStartSLOduration=9.276311306 podStartE2EDuration="29.11169808s" totalImagesPullingTime="19.835386774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 16:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:47:29.111292972 +0000 UTC m=+28.882323280" watchObservedRunningTime="2026-07-31 16:47:29.11169808 +0000 UTC m=+28.882728387" Jul 31 16:47:29.716977 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:29.716947 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:29.717159 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:29.717074 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmdcm" podUID="74210898-48a8-42d3-a8f1-25708d2719cb" Jul 31 16:47:29.717159 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:29.717136 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:29.717876 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:29.717256 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s2csx" podUID="7528c182-537a-43db-b0bd-5633029d814c" Jul 31 16:47:30.068079 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:30.067998 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:30.068223 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:30.068080 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:30.068223 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:30.068124 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:30.082722 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:30.082698 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:30.082961 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:30.082944 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:47:30.717891 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:30.717814 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:30.718359 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:30.717891 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:31.058273 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:31.058018 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s2csx"] Jul 31 16:47:31.058627 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:31.058565 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:31.058803 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:31.058684 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s2csx" podUID="7528c182-537a-43db-b0bd-5633029d814c" Jul 31 16:47:31.061492 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:31.061469 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fmdcm"] Jul 31 16:47:31.061603 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:31.061554 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:31.061656 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:31.061628 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmdcm" podUID="74210898-48a8-42d3-a8f1-25708d2719cb" Jul 31 16:47:31.071079 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:31.071057 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rdsbm"] Jul 31 16:47:31.074010 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:31.073981 2586 generic.go:356] "Generic (PLEG): container finished" podID="756d5c76-69ba-4b10-ae30-50b0ca29aa13" containerID="43865689976c8a2ab244291ede6efbaa53c7eaac9ece97bfce55e2053edcce56" exitCode=0 Jul 31 16:47:31.074139 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:31.074049 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:31.074139 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:31.074097 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bd2mc" event={"ID":"756d5c76-69ba-4b10-ae30-50b0ca29aa13","Type":"ContainerDied","Data":"43865689976c8a2ab244291ede6efbaa53c7eaac9ece97bfce55e2053edcce56"} Jul 31 16:47:31.074249 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:31.074148 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:32.717564 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:32.717531 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:32.717564 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:32.717566 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:32.718020 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:32.717531 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:32.718020 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:32.717660 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fmdcm" podUID="74210898-48a8-42d3-a8f1-25708d2719cb" Jul 31 16:47:32.718020 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:32.717776 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s2csx" podUID="7528c182-537a-43db-b0bd-5633029d814c" Jul 31 16:47:32.718020 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:32.717843 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rdsbm" podUID="c4753a62-82e4-4683-a90d-46ead858670b" Jul 31 16:47:33.080525 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:33.080490 2586 generic.go:356] "Generic (PLEG): container finished" podID="756d5c76-69ba-4b10-ae30-50b0ca29aa13" containerID="470f41538a202e6af3335b35824835b7273ab317dd19f794f27db4c35411068b" exitCode=0 Jul 31 16:47:33.080676 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:33.080548 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bd2mc" event={"ID":"756d5c76-69ba-4b10-ae30-50b0ca29aa13","Type":"ContainerDied","Data":"470f41538a202e6af3335b35824835b7273ab317dd19f794f27db4c35411068b"} Jul 31 16:47:33.505597 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:33.505494 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret\") pod \"global-pull-secret-syncer-s2csx\" (UID: \"7528c182-537a-43db-b0bd-5633029d814c\") " pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:33.505597 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:33.505538 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs\") pod \"network-metrics-daemon-fmdcm\" (UID: \"74210898-48a8-42d3-a8f1-25708d2719cb\") " pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:33.505597 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:33.505580 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptdg5\" (UniqueName: \"kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5\") pod \"network-check-target-rdsbm\" (UID: \"c4753a62-82e4-4683-a90d-46ead858670b\") " pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:33.505824 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:33.505656 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 16:47:33.505824 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:33.505656 2586 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 31 16:47:33.505824 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:33.505725 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 31 16:47:33.505824 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:33.505741 2586 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 31 16:47:33.505824 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:33.505707 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs podName:74210898-48a8-42d3-a8f1-25708d2719cb nodeName:}" failed. No retries permitted until 2026-07-31 16:48:05.505690388 +0000 UTC m=+65.276720674 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs") pod "network-metrics-daemon-fmdcm" (UID: "74210898-48a8-42d3-a8f1-25708d2719cb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 31 16:47:33.505824 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:33.505753 2586 projected.go:196] Error preparing data for projected volume kube-api-access-ptdg5 for pod openshift-network-diagnostics/network-check-target-rdsbm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 16:47:33.505824 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:33.505776 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret podName:7528c182-537a-43db-b0bd-5633029d814c nodeName:}" failed. No retries permitted until 2026-07-31 16:48:05.505756777 +0000 UTC m=+65.276787076 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret") pod "global-pull-secret-syncer-s2csx" (UID: "7528c182-537a-43db-b0bd-5633029d814c") : object "kube-system"/"original-pull-secret" not registered Jul 31 16:47:33.505824 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:33.505794 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5 podName:c4753a62-82e4-4683-a90d-46ead858670b nodeName:}" failed. No retries permitted until 2026-07-31 16:48:05.505783611 +0000 UTC m=+65.276813897 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ptdg5" (UniqueName: "kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5") pod "network-check-target-rdsbm" (UID: "c4753a62-82e4-4683-a90d-46ead858670b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 31 16:47:34.531635 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.531550 2586 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-127.ec2.internal" event="NodeReady" Jul 31 16:47:34.532055 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.531689 2586 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 31 16:47:34.569035 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.568993 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75c6889569-9nvfx"] Jul 31 16:47:34.571154 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.571133 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.573728 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.573692 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 31 16:47:34.574144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.574117 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 31 16:47:34.574272 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.574204 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h9fs6\"" Jul 31 16:47:34.574272 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.574204 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 31 16:47:34.581966 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.581945 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lndfz"] Jul 31 16:47:34.583206 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.583186 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 31 16:47:34.583743 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.583727 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lndfz" Jul 31 16:47:34.586065 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.586042 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 31 16:47:34.586288 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.586270 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 31 16:47:34.586372 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.586270 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-82sv2\"" Jul 31 16:47:34.586430 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.586386 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 31 16:47:34.590363 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.590342 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75c6889569-9nvfx"] Jul 31 16:47:34.591282 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.591260 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fn9kg"] Jul 31 16:47:34.593297 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.593277 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fn9kg" Jul 31 16:47:34.596014 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.595996 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 31 16:47:34.596284 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.596263 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gmz7r\"" Jul 31 16:47:34.596922 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.596902 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 31 16:47:34.597798 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.597776 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lndfz"] Jul 31 16:47:34.607890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.607868 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fn9kg"] Jul 31 16:47:34.714000 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.713967 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fwwt\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-kube-api-access-6fwwt\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.714155 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.714002 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0428e92-6379-4b17-9cec-b8b46368d631-trusted-ca\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.714155 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.714033 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:47:34.714155 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.714090 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0428e92-6379-4b17-9cec-b8b46368d631-registry-certificates\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.714155 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.714118 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.714155 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.714139 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-bound-sa-token\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.714430 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.714163 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0428e92-6379-4b17-9cec-b8b46368d631-image-registry-private-configuration\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.714430 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.714213 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0428e92-6379-4b17-9cec-b8b46368d631-installation-pull-secrets\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.714430 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.714251 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4584e1cc-a4cd-4344-a274-416715cdc3e3-config-volume\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:47:34.714430 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.714348 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0428e92-6379-4b17-9cec-b8b46368d631-ca-trust-extracted\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.714430 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.714372 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4584e1cc-a4cd-4344-a274-416715cdc3e3-tmp-dir\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:47:34.714430 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.714407 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndcr8\" (UniqueName: \"kubernetes.io/projected/4584e1cc-a4cd-4344-a274-416715cdc3e3-kube-api-access-ndcr8\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:47:34.714684 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.714441 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c75fced-d017-49f8-939c-1a7922f8f194-cert\") pod \"ingress-canary-lndfz\" (UID: \"2c75fced-d017-49f8-939c-1a7922f8f194\") " pod="openshift-ingress-canary/ingress-canary-lndfz" Jul 31 16:47:34.714684 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.714488 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzr2b\" (UniqueName: \"kubernetes.io/projected/2c75fced-d017-49f8-939c-1a7922f8f194-kube-api-access-kzr2b\") pod \"ingress-canary-lndfz\" (UID: \"2c75fced-d017-49f8-939c-1a7922f8f194\") " pod="openshift-ingress-canary/ingress-canary-lndfz" Jul 31 16:47:34.717137 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.717113 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:47:34.717258 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.717148 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:47:34.717258 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.717113 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:47:34.720346 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.720326 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 31 16:47:34.720461 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.720378 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9pgg4\"" Jul 31 16:47:34.720504 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.720486 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 31 16:47:34.720545 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.720325 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bknw8\"" Jul 31 16:47:34.720598 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.720582 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 31 16:47:34.720667 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.720652 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 31 16:47:34.815803 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.815711 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndcr8\" (UniqueName: \"kubernetes.io/projected/4584e1cc-a4cd-4344-a274-416715cdc3e3-kube-api-access-ndcr8\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:47:34.815803 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.815760 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c75fced-d017-49f8-939c-1a7922f8f194-cert\") pod \"ingress-canary-lndfz\" (UID: \"2c75fced-d017-49f8-939c-1a7922f8f194\") " pod="openshift-ingress-canary/ingress-canary-lndfz" Jul 31 16:47:34.815803 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.815792 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzr2b\" (UniqueName: \"kubernetes.io/projected/2c75fced-d017-49f8-939c-1a7922f8f194-kube-api-access-kzr2b\") pod \"ingress-canary-lndfz\" (UID: \"2c75fced-d017-49f8-939c-1a7922f8f194\") " pod="openshift-ingress-canary/ingress-canary-lndfz" Jul 31 16:47:34.816054 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.815952 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fwwt\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-kube-api-access-6fwwt\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.816054 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.815986 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0428e92-6379-4b17-9cec-b8b46368d631-trusted-ca\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.816054 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.816026 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:47:34.816197 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.816121 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0428e92-6379-4b17-9cec-b8b46368d631-registry-certificates\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.816197 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.816157 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.816295 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.816206 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-bound-sa-token\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.816295 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.816239 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0428e92-6379-4b17-9cec-b8b46368d631-image-registry-private-configuration\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.816464 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.816430 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0428e92-6379-4b17-9cec-b8b46368d631-installation-pull-secrets\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.816590 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.816481 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4584e1cc-a4cd-4344-a274-416715cdc3e3-config-volume\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:47:34.816590 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.816524 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0428e92-6379-4b17-9cec-b8b46368d631-ca-trust-extracted\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.816590 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.816547 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4584e1cc-a4cd-4344-a274-416715cdc3e3-tmp-dir\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:47:34.816590 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:34.816556 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 16:47:34.816590 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:34.816574 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c6889569-9nvfx: secret "image-registry-tls" not found Jul 31 16:47:34.816845 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:34.816627 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls podName:e0428e92-6379-4b17-9cec-b8b46368d631 nodeName:}" failed. No retries permitted until 2026-07-31 16:47:35.31660819 +0000 UTC m=+35.087638508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls") pod "image-registry-75c6889569-9nvfx" (UID: "e0428e92-6379-4b17-9cec-b8b46368d631") : secret "image-registry-tls" not found Jul 31 16:47:34.817775 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:34.817740 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 16:47:34.817887 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:34.817851 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls podName:4584e1cc-a4cd-4344-a274-416715cdc3e3 nodeName:}" failed. No retries permitted until 2026-07-31 16:47:35.317832002 +0000 UTC m=+35.088862300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls") pod "dns-default-fn9kg" (UID: "4584e1cc-a4cd-4344-a274-416715cdc3e3") : secret "dns-default-metrics-tls" not found Jul 31 16:47:34.817887 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.817871 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0428e92-6379-4b17-9cec-b8b46368d631-trusted-ca\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.818012 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.817899 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4584e1cc-a4cd-4344-a274-416715cdc3e3-tmp-dir\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:47:34.818102 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.818070 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0428e92-6379-4b17-9cec-b8b46368d631-registry-certificates\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.818867 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.818841 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4584e1cc-a4cd-4344-a274-416715cdc3e3-config-volume\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:47:34.819062 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.818880 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0428e92-6379-4b17-9cec-b8b46368d631-ca-trust-extracted\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.820965 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.820931 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0428e92-6379-4b17-9cec-b8b46368d631-image-registry-private-configuration\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.821473 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.821428 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0428e92-6379-4b17-9cec-b8b46368d631-installation-pull-secrets\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.822731 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.822703 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2c75fced-d017-49f8-939c-1a7922f8f194-cert\") pod \"ingress-canary-lndfz\" (UID: \"2c75fced-d017-49f8-939c-1a7922f8f194\") " pod="openshift-ingress-canary/ingress-canary-lndfz" Jul 31 16:47:34.826215 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.825944 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndcr8\" (UniqueName: \"kubernetes.io/projected/4584e1cc-a4cd-4344-a274-416715cdc3e3-kube-api-access-ndcr8\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:47:34.826215 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.826145 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-bound-sa-token\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.826215 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.826183 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzr2b\" (UniqueName: \"kubernetes.io/projected/2c75fced-d017-49f8-939c-1a7922f8f194-kube-api-access-kzr2b\") pod \"ingress-canary-lndfz\" (UID: \"2c75fced-d017-49f8-939c-1a7922f8f194\") " pod="openshift-ingress-canary/ingress-canary-lndfz" Jul 31 16:47:34.826371 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.826354 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fwwt\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-kube-api-access-6fwwt\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:34.894367 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:34.894332 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lndfz" Jul 31 16:47:35.045631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:35.045442 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lndfz"] Jul 31 16:47:35.049178 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:47:35.049153 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c75fced_d017_49f8_939c_1a7922f8f194.slice/crio-17a25a35f51c157f4423b8616e92d5c80abb8be7c411a9fe6d1d066d3b6dea67 WatchSource:0}: Error finding container 17a25a35f51c157f4423b8616e92d5c80abb8be7c411a9fe6d1d066d3b6dea67: Status 404 returned error can't find the container with id 17a25a35f51c157f4423b8616e92d5c80abb8be7c411a9fe6d1d066d3b6dea67 Jul 31 16:47:35.086833 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:35.086762 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lndfz" event={"ID":"2c75fced-d017-49f8-939c-1a7922f8f194","Type":"ContainerStarted","Data":"17a25a35f51c157f4423b8616e92d5c80abb8be7c411a9fe6d1d066d3b6dea67"} Jul 31 16:47:35.320055 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:35.320013 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:47:35.320244 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:35.320086 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:35.320244 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:35.320140 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 16:47:35.320244 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:35.320186 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 16:47:35.320244 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:35.320198 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c6889569-9nvfx: secret "image-registry-tls" not found Jul 31 16:47:35.320244 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:35.320221 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls podName:4584e1cc-a4cd-4344-a274-416715cdc3e3 nodeName:}" failed. No retries permitted until 2026-07-31 16:47:36.320200116 +0000 UTC m=+36.091230402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls") pod "dns-default-fn9kg" (UID: "4584e1cc-a4cd-4344-a274-416715cdc3e3") : secret "dns-default-metrics-tls" not found Jul 31 16:47:35.320244 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:35.320249 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls podName:e0428e92-6379-4b17-9cec-b8b46368d631 nodeName:}" failed. No retries permitted until 2026-07-31 16:47:36.320232691 +0000 UTC m=+36.091262976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls") pod "image-registry-75c6889569-9nvfx" (UID: "e0428e92-6379-4b17-9cec-b8b46368d631") : secret "image-registry-tls" not found Jul 31 16:47:36.180679 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:36.180637 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:47:36.283133 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:36.283100 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:47:36.329251 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:36.329212 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:47:36.329436 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:36.329309 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:36.329436 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:36.329365 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 16:47:36.329581 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:36.329439 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls podName:4584e1cc-a4cd-4344-a274-416715cdc3e3 nodeName:}" failed. No retries permitted until 2026-07-31 16:47:38.32941818 +0000 UTC m=+38.100448479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls") pod "dns-default-fn9kg" (UID: "4584e1cc-a4cd-4344-a274-416715cdc3e3") : secret "dns-default-metrics-tls" not found Jul 31 16:47:36.329581 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:36.329470 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 16:47:36.329581 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:36.329486 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c6889569-9nvfx: secret "image-registry-tls" not found Jul 31 16:47:36.329581 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:36.329545 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls podName:e0428e92-6379-4b17-9cec-b8b46368d631 nodeName:}" failed. No retries permitted until 2026-07-31 16:47:38.329529553 +0000 UTC m=+38.100559840 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls") pod "image-registry-75c6889569-9nvfx" (UID: "e0428e92-6379-4b17-9cec-b8b46368d631") : secret "image-registry-tls" not found Jul 31 16:47:36.362387 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:36.362357 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:47:38.343279 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:38.343237 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:47:38.343915 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:38.343355 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:38.343915 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:38.343414 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 16:47:38.343915 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:38.343499 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 16:47:38.343915 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:38.343507 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls podName:4584e1cc-a4cd-4344-a274-416715cdc3e3 nodeName:}" failed. No retries permitted until 2026-07-31 16:47:42.343487183 +0000 UTC m=+42.114517483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls") pod "dns-default-fn9kg" (UID: "4584e1cc-a4cd-4344-a274-416715cdc3e3") : secret "dns-default-metrics-tls" not found Jul 31 16:47:38.343915 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:38.343512 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c6889569-9nvfx: secret "image-registry-tls" not found Jul 31 16:47:38.343915 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:38.343561 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls podName:e0428e92-6379-4b17-9cec-b8b46368d631 nodeName:}" failed. No retries permitted until 2026-07-31 16:47:42.343545628 +0000 UTC m=+42.114575917 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls") pod "image-registry-75c6889569-9nvfx" (UID: "e0428e92-6379-4b17-9cec-b8b46368d631") : secret "image-registry-tls" not found Jul 31 16:47:39.239274 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:39.239240 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:47:39.635908 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:39.635875 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:47:39.692742 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:39.692693 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:47:40.101320 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:40.101290 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lndfz" event={"ID":"2c75fced-d017-49f8-939c-1a7922f8f194","Type":"ContainerStarted","Data":"6c586baa1ac138270ec44179f5b266ed42d15b1d9bb21bac89202d18c35803a8"} Jul 31 16:47:40.103875 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:40.103847 2586 generic.go:356] "Generic (PLEG): container finished" podID="756d5c76-69ba-4b10-ae30-50b0ca29aa13" containerID="7b0f79c6177e4206c0d809b9dca5b91e035ebd80f0e0fa66870a389e3a4dae38" exitCode=0 Jul 31 16:47:40.104002 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:40.103885 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bd2mc" event={"ID":"756d5c76-69ba-4b10-ae30-50b0ca29aa13","Type":"ContainerDied","Data":"7b0f79c6177e4206c0d809b9dca5b91e035ebd80f0e0fa66870a389e3a4dae38"} Jul 31 16:47:40.117860 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:40.117562 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lndfz" podStartSLOduration=2.095311012 podStartE2EDuration="6.11754175s" totalImagesPullingTime="4.022230738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:47:40.117360943 +0000 UTC m=+39.888391249" watchObservedRunningTime="2026-07-31 16:47:40.11754175 +0000 UTC m=+39.888572060" Jul 31 16:47:41.111193 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:41.111151 2586 generic.go:356] "Generic (PLEG): container finished" podID="756d5c76-69ba-4b10-ae30-50b0ca29aa13" containerID="2cdbf2ac160d3570c4fbb010884f996b81108f3841088de62d3b6fe55624bbf6" exitCode=0 Jul 31 16:47:41.111631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:41.111233 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bd2mc" event={"ID":"756d5c76-69ba-4b10-ae30-50b0ca29aa13","Type":"ContainerDied","Data":"2cdbf2ac160d3570c4fbb010884f996b81108f3841088de62d3b6fe55624bbf6"} Jul 31 16:47:42.116337 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:42.116296 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bd2mc" event={"ID":"756d5c76-69ba-4b10-ae30-50b0ca29aa13","Type":"ContainerStarted","Data":"c6afbf4358fae5b1384b5e01198af2508f0bf33a3ded6c06ee3ca4928fe90b44"} Jul 31 16:47:42.141854 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:42.141791 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bd2mc" podStartSLOduration=6.949928791 podStartE2EDuration="41.141773409s" totalImagesPullingTime="34.191844618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 16:47:01 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:47:42.140414097 +0000 UTC m=+41.911444405" watchObservedRunningTime="2026-07-31 16:47:42.141773409 +0000 UTC m=+41.912803720" Jul 31 16:47:42.265419 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:42.265377 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:47:42.338646 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:42.338602 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:47:42.375615 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:42.375541 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:47:42.375761 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:42.375621 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:42.375761 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:42.375676 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 16:47:42.375761 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:42.375735 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls podName:4584e1cc-a4cd-4344-a274-416715cdc3e3 nodeName:}" failed. No retries permitted until 2026-07-31 16:47:50.375720465 +0000 UTC m=+50.146750751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls") pod "dns-default-fn9kg" (UID: "4584e1cc-a4cd-4344-a274-416715cdc3e3") : secret "dns-default-metrics-tls" not found Jul 31 16:47:42.375761 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:42.375748 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 16:47:42.375761 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:42.375763 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c6889569-9nvfx: secret "image-registry-tls" not found Jul 31 16:47:42.375956 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:42.375810 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls podName:e0428e92-6379-4b17-9cec-b8b46368d631 nodeName:}" failed. No retries permitted until 2026-07-31 16:47:50.375794738 +0000 UTC m=+50.146825026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls") pod "image-registry-75c6889569-9nvfx" (UID: "e0428e92-6379-4b17-9cec-b8b46368d631") : secret "image-registry-tls" not found Jul 31 16:47:42.697503 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:42.697383 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:47:42.761237 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:42.761206 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:47:44.188333 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:44.188281 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:47:50.430086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:50.430047 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:47:50.430492 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:50.430112 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:47:50.430492 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:50.430192 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 16:47:50.430492 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:50.430215 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c6889569-9nvfx: secret "image-registry-tls" not found Jul 31 16:47:50.430492 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:50.430201 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 16:47:50.430492 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:50.430280 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls podName:e0428e92-6379-4b17-9cec-b8b46368d631 nodeName:}" failed. No retries permitted until 2026-07-31 16:48:06.430265439 +0000 UTC m=+66.201295725 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls") pod "image-registry-75c6889569-9nvfx" (UID: "e0428e92-6379-4b17-9cec-b8b46368d631") : secret "image-registry-tls" not found Jul 31 16:47:50.430492 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:47:50.430293 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls podName:4584e1cc-a4cd-4344-a274-416715cdc3e3 nodeName:}" failed. No retries permitted until 2026-07-31 16:48:06.430287675 +0000 UTC m=+66.201317962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls") pod "dns-default-fn9kg" (UID: "4584e1cc-a4cd-4344-a274-416715cdc3e3") : secret "dns-default-metrics-tls" not found Jul 31 16:47:59.989291 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:47:59.989259 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:48:01.166356 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:01.166323 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:48:01.357437 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:01.357403 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:48:01.419992 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:01.419916 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:48:01.476525 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:01.476492 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:48:02.086657 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:02.086630 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fn5jp" Jul 31 16:48:02.357658 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:02.357574 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:48:02.414242 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:02.414170 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:48:02.767429 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:02.767395 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:48:02.874623 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:02.874591 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:48:04.661796 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:04.661764 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:48:04.717970 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:04.717942 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:48:05.535546 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:05.535507 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptdg5\" (UniqueName: \"kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5\") pod \"network-check-target-rdsbm\" (UID: \"c4753a62-82e4-4683-a90d-46ead858670b\") " pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:48:05.535546 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:05.535549 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret\") pod \"global-pull-secret-syncer-s2csx\" (UID: \"7528c182-537a-43db-b0bd-5633029d814c\") " pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:48:05.535778 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:05.535577 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs\") pod \"network-metrics-daemon-fmdcm\" (UID: \"74210898-48a8-42d3-a8f1-25708d2719cb\") " pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:48:05.538379 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:05.538362 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 31 16:48:05.538435 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:05.538371 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 31 16:48:05.538493 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:05.538467 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 31 16:48:05.546660 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:05.546641 2586 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 31 16:48:05.546725 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:05.546714 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs podName:74210898-48a8-42d3-a8f1-25708d2719cb nodeName:}" failed. No retries permitted until 2026-07-31 16:49:09.54669563 +0000 UTC m=+129.317725919 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs") pod "network-metrics-daemon-fmdcm" (UID: "74210898-48a8-42d3-a8f1-25708d2719cb") : secret "metrics-daemon-secret" not found Jul 31 16:48:05.548965 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:05.548937 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 31 16:48:05.549325 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:05.549305 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7528c182-537a-43db-b0bd-5633029d814c-original-pull-secret\") pod \"global-pull-secret-syncer-s2csx\" (UID: \"7528c182-537a-43db-b0bd-5633029d814c\") " pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:48:05.558909 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:05.558890 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptdg5\" (UniqueName: \"kubernetes.io/projected/c4753a62-82e4-4683-a90d-46ead858670b-kube-api-access-ptdg5\") pod \"network-check-target-rdsbm\" (UID: \"c4753a62-82e4-4683-a90d-46ead858670b\") " pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:48:05.637285 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:05.637254 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9pgg4\"" Jul 31 16:48:05.639370 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:05.639353 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s2csx" Jul 31 16:48:05.645329 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:05.645310 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:48:05.773026 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:05.772997 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s2csx"] Jul 31 16:48:05.775980 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:48:05.775948 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7528c182_537a_43db_b0bd_5633029d814c.slice/crio-94155bac92ab7686efd65834192946ac2e0a577b55ac2481a1cda880426eac6d WatchSource:0}: Error finding container 94155bac92ab7686efd65834192946ac2e0a577b55ac2481a1cda880426eac6d: Status 404 returned error can't find the container with id 94155bac92ab7686efd65834192946ac2e0a577b55ac2481a1cda880426eac6d Jul 31 16:48:05.788135 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:05.785421 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rdsbm"] Jul 31 16:48:05.792376 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:48:05.792346 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4753a62_82e4_4683_a90d_46ead858670b.slice/crio-1de45916246cc5fa392d41b569b39367b4c1a3effb1ff7bc8ed24a1c93b87a89 WatchSource:0}: Error finding container 1de45916246cc5fa392d41b569b39367b4c1a3effb1ff7bc8ed24a1c93b87a89: Status 404 returned error can't find the container with id 1de45916246cc5fa392d41b569b39367b4c1a3effb1ff7bc8ed24a1c93b87a89 Jul 31 16:48:06.171661 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:06.171574 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rdsbm" event={"ID":"c4753a62-82e4-4683-a90d-46ead858670b","Type":"ContainerStarted","Data":"1de45916246cc5fa392d41b569b39367b4c1a3effb1ff7bc8ed24a1c93b87a89"} Jul 31 16:48:06.172626 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:06.172604 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s2csx" event={"ID":"7528c182-537a-43db-b0bd-5633029d814c","Type":"ContainerStarted","Data":"94155bac92ab7686efd65834192946ac2e0a577b55ac2481a1cda880426eac6d"} Jul 31 16:48:06.442239 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:06.442145 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:48:06.442406 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:06.442307 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:48:06.442406 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:06.442313 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 16:48:06.442406 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:06.442397 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 16:48:06.442607 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:06.442417 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c6889569-9nvfx: secret "image-registry-tls" not found Jul 31 16:48:06.442607 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:06.442419 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls podName:4584e1cc-a4cd-4344-a274-416715cdc3e3 nodeName:}" failed. No retries permitted until 2026-07-31 16:48:38.442404521 +0000 UTC m=+98.213434807 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls") pod "dns-default-fn9kg" (UID: "4584e1cc-a4cd-4344-a274-416715cdc3e3") : secret "dns-default-metrics-tls" not found Jul 31 16:48:06.442607 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:06.442513 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls podName:e0428e92-6379-4b17-9cec-b8b46368d631 nodeName:}" failed. No retries permitted until 2026-07-31 16:48:38.442494491 +0000 UTC m=+98.213524782 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls") pod "image-registry-75c6889569-9nvfx" (UID: "e0428e92-6379-4b17-9cec-b8b46368d631") : secret "image-registry-tls" not found Jul 31 16:48:11.190159 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:11.190121 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rdsbm" event={"ID":"c4753a62-82e4-4683-a90d-46ead858670b","Type":"ContainerStarted","Data":"2eb8e60702726dfb5478ecaf2b7760ba207f6f0d7dc046d85f12d2869321d76c"} Jul 31 16:48:11.190651 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:11.190256 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:48:11.191609 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:11.191588 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s2csx" event={"ID":"7528c182-537a-43db-b0bd-5633029d814c","Type":"ContainerStarted","Data":"1b76f5299b0a21d95b9768e3904acff32a048710113a13f2a096d4454de0df79"} Jul 31 16:48:11.207434 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:11.207388 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rdsbm" podStartSLOduration=66.47836866 podStartE2EDuration="1m11.207375507s" totalImagesPullingTime="4.729006847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:47:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:48:11.206395275 +0000 UTC m=+70.977425584" watchObservedRunningTime="2026-07-31 16:48:11.207375507 +0000 UTC m=+70.978405793" Jul 31 16:48:11.920532 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:11.920481 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s2csx" podStartSLOduration=66.171379811 podStartE2EDuration="1m10.920442818s" totalImagesPullingTime="4.749063007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 16:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:48:11.223681603 +0000 UTC m=+70.994711912" watchObservedRunningTime="2026-07-31 16:48:11.920442818 +0000 UTC m=+71.691473133" Jul 31 16:48:11.920895 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:11.920862 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm"] Jul 31 16:48:11.922657 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:11.922641 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm" Jul 31 16:48:11.926752 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:11.926727 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 31 16:48:11.926752 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:11.926732 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 31 16:48:11.926928 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:11.926767 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 31 16:48:11.926928 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:11.926748 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 31 16:48:11.931075 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:11.931052 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm"] Jul 31 16:48:11.983828 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:11.983788 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsdxx\" (UniqueName: \"kubernetes.io/projected/44c43562-8fb6-411a-8d5c-b8c3a6a7d67f-kube-api-access-wsdxx\") pod \"klusterlet-addon-workmgr-796448b77d-jz6sm\" (UID: \"44c43562-8fb6-411a-8d5c-b8c3a6a7d67f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm" Jul 31 16:48:11.984006 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:11.983890 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/44c43562-8fb6-411a-8d5c-b8c3a6a7d67f-klusterlet-config\") pod \"klusterlet-addon-workmgr-796448b77d-jz6sm\" (UID: \"44c43562-8fb6-411a-8d5c-b8c3a6a7d67f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm" Jul 31 16:48:11.984006 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:11.983918 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44c43562-8fb6-411a-8d5c-b8c3a6a7d67f-tmp\") pod \"klusterlet-addon-workmgr-796448b77d-jz6sm\" (UID: \"44c43562-8fb6-411a-8d5c-b8c3a6a7d67f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm" Jul 31 16:48:12.084259 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:12.084224 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44c43562-8fb6-411a-8d5c-b8c3a6a7d67f-tmp\") pod \"klusterlet-addon-workmgr-796448b77d-jz6sm\" (UID: \"44c43562-8fb6-411a-8d5c-b8c3a6a7d67f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm" Jul 31 16:48:12.084381 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:12.084279 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsdxx\" (UniqueName: \"kubernetes.io/projected/44c43562-8fb6-411a-8d5c-b8c3a6a7d67f-kube-api-access-wsdxx\") pod \"klusterlet-addon-workmgr-796448b77d-jz6sm\" (UID: \"44c43562-8fb6-411a-8d5c-b8c3a6a7d67f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm" Jul 31 16:48:12.084381 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:12.084338 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/44c43562-8fb6-411a-8d5c-b8c3a6a7d67f-klusterlet-config\") pod \"klusterlet-addon-workmgr-796448b77d-jz6sm\" (UID: \"44c43562-8fb6-411a-8d5c-b8c3a6a7d67f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm" Jul 31 16:48:12.084639 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:12.084617 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/44c43562-8fb6-411a-8d5c-b8c3a6a7d67f-tmp\") pod \"klusterlet-addon-workmgr-796448b77d-jz6sm\" (UID: \"44c43562-8fb6-411a-8d5c-b8c3a6a7d67f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm" Jul 31 16:48:12.086711 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:12.086683 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/44c43562-8fb6-411a-8d5c-b8c3a6a7d67f-klusterlet-config\") pod \"klusterlet-addon-workmgr-796448b77d-jz6sm\" (UID: \"44c43562-8fb6-411a-8d5c-b8c3a6a7d67f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm" Jul 31 16:48:12.093406 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:12.093382 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsdxx\" (UniqueName: \"kubernetes.io/projected/44c43562-8fb6-411a-8d5c-b8c3a6a7d67f-kube-api-access-wsdxx\") pod \"klusterlet-addon-workmgr-796448b77d-jz6sm\" (UID: \"44c43562-8fb6-411a-8d5c-b8c3a6a7d67f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm" Jul 31 16:48:12.232416 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:12.232327 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm" Jul 31 16:48:12.350867 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:12.350836 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm"] Jul 31 16:48:12.354169 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:48:12.354141 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c43562_8fb6_411a_8d5c_b8c3a6a7d67f.slice/crio-a36965df1babd259d6e59e24b3eb725fb66ccdba0739732a59339cf326d91749 WatchSource:0}: Error finding container a36965df1babd259d6e59e24b3eb725fb66ccdba0739732a59339cf326d91749: Status 404 returned error can't find the container with id a36965df1babd259d6e59e24b3eb725fb66ccdba0739732a59339cf326d91749 Jul 31 16:48:13.196647 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:13.196613 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm" event={"ID":"44c43562-8fb6-411a-8d5c-b8c3a6a7d67f","Type":"ContainerStarted","Data":"a36965df1babd259d6e59e24b3eb725fb66ccdba0739732a59339cf326d91749"} Jul 31 16:48:14.779278 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:14.779244 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:48:14.880753 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:14.880721 2586 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" limit=1024 Jul 31 16:48:29.238605 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:29.238570 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm" event={"ID":"44c43562-8fb6-411a-8d5c-b8c3a6a7d67f","Type":"ContainerStarted","Data":"fe91bed79b6f85a93280d658020db84acbfb6cfdf9d603d716dc5fa3ad3f964e"} Jul 31 16:48:29.238993 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:29.238773 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm" Jul 31 16:48:29.240384 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:29.240364 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm" Jul 31 16:48:29.258079 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:29.258033 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-796448b77d-jz6sm" podStartSLOduration=2.3711696460000002 podStartE2EDuration="18.258020597s" totalImagesPullingTime="15.886850951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:48:29.257858249 +0000 UTC m=+89.028888557" watchObservedRunningTime="2026-07-31 16:48:29.258020597 +0000 UTC m=+89.029050904" Jul 31 16:48:38.478261 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:38.478214 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:48:38.478682 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:38.478275 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls\") pod \"image-registry-75c6889569-9nvfx\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:48:38.478682 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:38.478383 2586 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 31 16:48:38.478682 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:38.478394 2586 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75c6889569-9nvfx: secret "image-registry-tls" not found Jul 31 16:48:38.478682 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:38.478411 2586 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 31 16:48:38.478682 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:38.478473 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls podName:e0428e92-6379-4b17-9cec-b8b46368d631 nodeName:}" failed. No retries permitted until 2026-07-31 16:49:42.478439797 +0000 UTC m=+162.249470082 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls") pod "image-registry-75c6889569-9nvfx" (UID: "e0428e92-6379-4b17-9cec-b8b46368d631") : secret "image-registry-tls" not found Jul 31 16:48:38.478682 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:38.478500 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls podName:4584e1cc-a4cd-4344-a274-416715cdc3e3 nodeName:}" failed. No retries permitted until 2026-07-31 16:49:42.4784854 +0000 UTC m=+162.249515703 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls") pod "dns-default-fn9kg" (UID: "4584e1cc-a4cd-4344-a274-416715cdc3e3") : secret "dns-default-metrics-tls" not found Jul 31 16:48:42.196232 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.196200 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rdsbm" Jul 31 16:48:42.484201 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.484113 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ffstb"] Jul 31 16:48:42.519125 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.519097 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ffstb"] Jul 31 16:48:42.519267 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.519216 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:42.521839 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.521816 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 31 16:48:42.522418 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.522404 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 31 16:48:42.522517 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.522501 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 31 16:48:42.522573 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.522515 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 31 16:48:42.523069 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.523053 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9cdvl\"" Jul 31 16:48:42.609578 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.609542 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:42.609578 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.609580 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfbmt\" (UniqueName: \"kubernetes.io/projected/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-api-access-dfbmt\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:42.609775 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.609681 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbe6f776-86dc-4704-a1fe-e655dcf25bad-data-volume\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:42.609775 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.609708 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:42.609775 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.609729 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dbe6f776-86dc-4704-a1fe-e655dcf25bad-crio-socket\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:42.710170 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.710136 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:42.710317 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.710176 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfbmt\" (UniqueName: \"kubernetes.io/projected/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-api-access-dfbmt\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:42.710317 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.710238 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbe6f776-86dc-4704-a1fe-e655dcf25bad-data-volume\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:42.710317 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.710256 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:42.710317 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.710273 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dbe6f776-86dc-4704-a1fe-e655dcf25bad-crio-socket\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:42.710317 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:42.710306 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 16:48:42.710575 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.710364 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dbe6f776-86dc-4704-a1fe-e655dcf25bad-crio-socket\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:42.710575 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:42.710382 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls podName:dbe6f776-86dc-4704-a1fe-e655dcf25bad nodeName:}" failed. No retries permitted until 2026-07-31 16:48:43.210362238 +0000 UTC m=+102.981392531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ffstb" (UID: "dbe6f776-86dc-4704-a1fe-e655dcf25bad") : secret "insights-runtime-extractor-tls" not found Jul 31 16:48:42.710575 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:42.710404 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 16:48:42.710575 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:42.710504 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm podName:dbe6f776-86dc-4704-a1fe-e655dcf25bad nodeName:}" failed. No retries permitted until 2026-07-31 16:48:43.210486245 +0000 UTC m=+102.981516545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ffstb" (UID: "dbe6f776-86dc-4704-a1fe-e655dcf25bad") : configmap "kube-rbac-proxy" not found Jul 31 16:48:42.710575 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.710550 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbe6f776-86dc-4704-a1fe-e655dcf25bad-data-volume\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:42.720728 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:42.720708 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfbmt\" (UniqueName: \"kubernetes.io/projected/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-api-access-dfbmt\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:43.035903 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:43.035868 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-kbssd"] Jul 31 16:48:43.052055 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:43.052031 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-kbssd"] Jul 31 16:48:43.052179 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:43.052141 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kbssd" Jul 31 16:48:43.054774 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:43.054755 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 31 16:48:43.054774 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:43.054755 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 31 16:48:43.054949 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:43.054760 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-x8tdn\"" Jul 31 16:48:43.113113 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:43.113076 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swqj8\" (UniqueName: \"kubernetes.io/projected/b480b79e-d002-46cb-9c96-4093dcc862ee-kube-api-access-swqj8\") pod \"migrator-68bc745d87-kbssd\" (UID: \"b480b79e-d002-46cb-9c96-4093dcc862ee\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kbssd" Jul 31 16:48:43.213955 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:43.213925 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:43.214356 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:43.213962 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swqj8\" (UniqueName: \"kubernetes.io/projected/b480b79e-d002-46cb-9c96-4093dcc862ee-kube-api-access-swqj8\") pod \"migrator-68bc745d87-kbssd\" (UID: \"b480b79e-d002-46cb-9c96-4093dcc862ee\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kbssd" Jul 31 16:48:43.214356 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:43.214014 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:43.214356 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:43.214044 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 16:48:43.214356 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:43.214117 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm podName:dbe6f776-86dc-4704-a1fe-e655dcf25bad nodeName:}" failed. No retries permitted until 2026-07-31 16:48:44.214099688 +0000 UTC m=+103.985129993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ffstb" (UID: "dbe6f776-86dc-4704-a1fe-e655dcf25bad") : configmap "kube-rbac-proxy" not found Jul 31 16:48:43.214356 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:43.214125 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 16:48:43.214356 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:43.214158 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls podName:dbe6f776-86dc-4704-a1fe-e655dcf25bad nodeName:}" failed. No retries permitted until 2026-07-31 16:48:44.214148915 +0000 UTC m=+103.985179201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ffstb" (UID: "dbe6f776-86dc-4704-a1fe-e655dcf25bad") : secret "insights-runtime-extractor-tls" not found Jul 31 16:48:43.222194 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:43.222172 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swqj8\" (UniqueName: \"kubernetes.io/projected/b480b79e-d002-46cb-9c96-4093dcc862ee-kube-api-access-swqj8\") pod \"migrator-68bc745d87-kbssd\" (UID: \"b480b79e-d002-46cb-9c96-4093dcc862ee\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kbssd" Jul 31 16:48:43.361241 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:43.361166 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kbssd" Jul 31 16:48:43.501472 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:43.501393 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-kbssd"] Jul 31 16:48:43.505021 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:48:43.504994 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb480b79e_d002_46cb_9c96_4093dcc862ee.slice/crio-fb6799c843b4fdda0d130cbe42e63827e9a4ef8831f51a754d65d651a2a5f690 WatchSource:0}: Error finding container fb6799c843b4fdda0d130cbe42e63827e9a4ef8831f51a754d65d651a2a5f690: Status 404 returned error can't find the container with id fb6799c843b4fdda0d130cbe42e63827e9a4ef8831f51a754d65d651a2a5f690 Jul 31 16:48:44.223230 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:44.223193 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:44.223733 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:44.223301 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:44.223733 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:44.223372 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 16:48:44.223733 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:44.223404 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 16:48:44.223733 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:44.223473 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm podName:dbe6f776-86dc-4704-a1fe-e655dcf25bad nodeName:}" failed. No retries permitted until 2026-07-31 16:48:46.223441626 +0000 UTC m=+105.994471912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ffstb" (UID: "dbe6f776-86dc-4704-a1fe-e655dcf25bad") : configmap "kube-rbac-proxy" not found Jul 31 16:48:44.223733 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:44.223493 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls podName:dbe6f776-86dc-4704-a1fe-e655dcf25bad nodeName:}" failed. No retries permitted until 2026-07-31 16:48:46.223483203 +0000 UTC m=+105.994513489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ffstb" (UID: "dbe6f776-86dc-4704-a1fe-e655dcf25bad") : secret "insights-runtime-extractor-tls" not found Jul 31 16:48:44.274528 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:44.274490 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kbssd" event={"ID":"b480b79e-d002-46cb-9c96-4093dcc862ee","Type":"ContainerStarted","Data":"fb6799c843b4fdda0d130cbe42e63827e9a4ef8831f51a754d65d651a2a5f690"} Jul 31 16:48:44.653335 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:44.653309 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v6vm6_be2ba90e-7372-4e7f-bed4-ad0616ea12fd/dns-node-resolver/0.log" Jul 31 16:48:45.279443 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:45.279407 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kbssd" event={"ID":"b480b79e-d002-46cb-9c96-4093dcc862ee","Type":"ContainerStarted","Data":"3e9ebb3530dc609113ee95ad46b3a6599fb368c4bd71dd5d0d9e05136f58214d"} Jul 31 16:48:45.279821 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:45.279480 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kbssd" event={"ID":"b480b79e-d002-46cb-9c96-4093dcc862ee","Type":"ContainerStarted","Data":"4cde02c7882b3e962c5fa08b5b64199649278b91e12dd4f6587c77a3d0f69350"} Jul 31 16:48:45.302356 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:45.302308 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-kbssd" podStartSLOduration=0.931390524 podStartE2EDuration="2.302294132s" totalImagesPullingTime="1.370903608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:48:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:48:45.301968104 +0000 UTC m=+105.072998413" watchObservedRunningTime="2026-07-31 16:48:45.302294132 +0000 UTC m=+105.073324439" Jul 31 16:48:45.456743 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:45.456715 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ngdrm_b8937e2d-a751-457b-946d-3cb74eb3e2a2/node-ca/0.log" Jul 31 16:48:46.052309 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:46.052278 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lndfz_2c75fced-d017-49f8-939c-1a7922f8f194/serve-healthcheck-canary/0.log" Jul 31 16:48:46.237671 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:46.237635 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:46.237840 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:46.237721 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:46.237840 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:46.237792 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 16:48:46.237840 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:46.237800 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 16:48:46.237940 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:46.237858 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls podName:dbe6f776-86dc-4704-a1fe-e655dcf25bad nodeName:}" failed. No retries permitted until 2026-07-31 16:48:50.237843431 +0000 UTC m=+110.008873722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ffstb" (UID: "dbe6f776-86dc-4704-a1fe-e655dcf25bad") : secret "insights-runtime-extractor-tls" not found Jul 31 16:48:46.237940 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:46.237876 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm podName:dbe6f776-86dc-4704-a1fe-e655dcf25bad nodeName:}" failed. No retries permitted until 2026-07-31 16:48:50.237869147 +0000 UTC m=+110.008899433 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ffstb" (UID: "dbe6f776-86dc-4704-a1fe-e655dcf25bad") : configmap "kube-rbac-proxy" not found Jul 31 16:48:50.268626 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:50.268589 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:50.268990 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:50.268653 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:50.268990 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:50.268711 2586 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 31 16:48:50.268990 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:50.268761 2586 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 31 16:48:50.268990 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:50.268797 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm podName:dbe6f776-86dc-4704-a1fe-e655dcf25bad nodeName:}" failed. No retries permitted until 2026-07-31 16:48:58.268781155 +0000 UTC m=+118.039811442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ffstb" (UID: "dbe6f776-86dc-4704-a1fe-e655dcf25bad") : configmap "kube-rbac-proxy" not found Jul 31 16:48:50.268990 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:48:50.268813 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls podName:dbe6f776-86dc-4704-a1fe-e655dcf25bad nodeName:}" failed. No retries permitted until 2026-07-31 16:48:58.268806819 +0000 UTC m=+118.039837104 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ffstb" (UID: "dbe6f776-86dc-4704-a1fe-e655dcf25bad") : secret "insights-runtime-extractor-tls" not found Jul 31 16:48:58.332485 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:58.332438 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:58.332910 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:58.332552 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:58.333057 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:58.333033 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dbe6f776-86dc-4704-a1fe-e655dcf25bad-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:58.335043 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:58.335022 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dbe6f776-86dc-4704-a1fe-e655dcf25bad-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ffstb\" (UID: \"dbe6f776-86dc-4704-a1fe-e655dcf25bad\") " pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:58.428154 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:58.428118 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ffstb" Jul 31 16:48:58.550880 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:58.550848 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ffstb"] Jul 31 16:48:58.553683 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:48:58.553656 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbe6f776_86dc_4704_a1fe_e655dcf25bad.slice/crio-f72fda0c8f39c6240ad44e0607b68bec63b18cfcec01a6da327572e1a954a2c8 WatchSource:0}: Error finding container f72fda0c8f39c6240ad44e0607b68bec63b18cfcec01a6da327572e1a954a2c8: Status 404 returned error can't find the container with id f72fda0c8f39c6240ad44e0607b68bec63b18cfcec01a6da327572e1a954a2c8 Jul 31 16:48:59.319703 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:59.319664 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ffstb" event={"ID":"dbe6f776-86dc-4704-a1fe-e655dcf25bad","Type":"ContainerStarted","Data":"db840319f79eb5c1ff928a479344155757e11ae9c87b513c8a94c7690775a484"} Jul 31 16:48:59.319879 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:59.319731 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ffstb" event={"ID":"dbe6f776-86dc-4704-a1fe-e655dcf25bad","Type":"ContainerStarted","Data":"f32c54eec816798d22c786be70705b1c99047c385eab405db144a993518387f3"} Jul 31 16:48:59.319879 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:48:59.319755 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ffstb" event={"ID":"dbe6f776-86dc-4704-a1fe-e655dcf25bad","Type":"ContainerStarted","Data":"f72fda0c8f39c6240ad44e0607b68bec63b18cfcec01a6da327572e1a954a2c8"} Jul 31 16:49:01.327709 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:01.327672 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ffstb" event={"ID":"dbe6f776-86dc-4704-a1fe-e655dcf25bad","Type":"ContainerStarted","Data":"79fc8ed76d1d1b164679bdfa2a49794cc0e9f28dcd2098eb08c9472ca8fa75ca"} Jul 31 16:49:01.347222 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:01.347181 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ffstb" podStartSLOduration=17.31814028 podStartE2EDuration="19.347168447s" totalImagesPullingTime="2.029028167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 16:48:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:49:01.345885071 +0000 UTC m=+121.116915378" watchObservedRunningTime="2026-07-31 16:49:01.347168447 +0000 UTC m=+121.118198777" Jul 31 16:49:03.753557 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.753523 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-f8zs6"] Jul 31 16:49:03.755589 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.755569 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-pnlnq"] Jul 31 16:49:03.755718 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.755700 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-f8zs6" Jul 31 16:49:03.757609 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.757585 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pnlnq" Jul 31 16:49:03.758666 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.758647 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 31 16:49:03.758666 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.758661 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 31 16:49:03.758804 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.758663 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-htnqf\"" Jul 31 16:49:03.758868 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.758849 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-p6vw6"] Jul 31 16:49:03.759899 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.759884 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-j9c6x\"" Jul 31 16:49:03.760599 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.760585 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-p6vw6" Jul 31 16:49:03.763249 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.763228 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 31 16:49:03.763339 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.763237 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 31 16:49:03.763537 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.763523 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vwgk4\"" Jul 31 16:49:03.771388 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.771363 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-f8zs6"] Jul 31 16:49:03.772573 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.772551 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-pnlnq"] Jul 31 16:49:03.775911 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.775889 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-p6vw6"] Jul 31 16:49:03.875114 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.875085 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjdqt\" (UniqueName: \"kubernetes.io/projected/023177fe-233f-4e8e-b1eb-906b0c21a7af-kube-api-access-tjdqt\") pod \"network-check-source-65bdbbff45-pnlnq\" (UID: \"023177fe-233f-4e8e-b1eb-906b0c21a7af\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pnlnq" Jul 31 16:49:03.875316 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.875177 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41f7e379-4acf-4b2c-a4c8-a1974d5f0f10-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-p6vw6\" (UID: \"41f7e379-4acf-4b2c-a4c8-a1974d5f0f10\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p6vw6" Jul 31 16:49:03.875316 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.875218 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvs6d\" (UniqueName: \"kubernetes.io/projected/1b024a5e-5d58-4ee0-bdd3-8bc7c7eccd34-kube-api-access-vvs6d\") pod \"volume-data-source-validator-5b8776669-f8zs6\" (UID: \"1b024a5e-5d58-4ee0-bdd3-8bc7c7eccd34\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-f8zs6" Jul 31 16:49:03.875316 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.875249 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41f7e379-4acf-4b2c-a4c8-a1974d5f0f10-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-p6vw6\" (UID: \"41f7e379-4acf-4b2c-a4c8-a1974d5f0f10\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p6vw6" Jul 31 16:49:03.878608 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.876800 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-hgcf4"] Jul 31 16:49:03.880112 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.879850 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-hgcf4" Jul 31 16:49:03.885343 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.885322 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 31 16:49:03.885948 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.885923 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 31 16:49:03.886210 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.886193 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 31 16:49:03.886344 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.886317 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-7cxc9\"" Jul 31 16:49:03.904105 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.904083 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-hgcf4"] Jul 31 16:49:03.976052 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.976018 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a0fee27-1fbf-40f9-8c1a-0cade39d28f3-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-hgcf4\" (UID: \"4a0fee27-1fbf-40f9-8c1a-0cade39d28f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-hgcf4" Jul 31 16:49:03.976218 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.976074 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjdqt\" (UniqueName: \"kubernetes.io/projected/023177fe-233f-4e8e-b1eb-906b0c21a7af-kube-api-access-tjdqt\") pod \"network-check-source-65bdbbff45-pnlnq\" (UID: \"023177fe-233f-4e8e-b1eb-906b0c21a7af\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pnlnq" Jul 31 16:49:03.976218 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.976166 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41f7e379-4acf-4b2c-a4c8-a1974d5f0f10-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-p6vw6\" (UID: \"41f7e379-4acf-4b2c-a4c8-a1974d5f0f10\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p6vw6" Jul 31 16:49:03.976218 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.976208 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvs6d\" (UniqueName: \"kubernetes.io/projected/1b024a5e-5d58-4ee0-bdd3-8bc7c7eccd34-kube-api-access-vvs6d\") pod \"volume-data-source-validator-5b8776669-f8zs6\" (UID: \"1b024a5e-5d58-4ee0-bdd3-8bc7c7eccd34\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-f8zs6" Jul 31 16:49:03.976396 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.976235 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsxt7\" (UniqueName: \"kubernetes.io/projected/4a0fee27-1fbf-40f9-8c1a-0cade39d28f3-kube-api-access-tsxt7\") pod \"cluster-samples-operator-559cbf5745-hgcf4\" (UID: \"4a0fee27-1fbf-40f9-8c1a-0cade39d28f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-hgcf4" Jul 31 16:49:03.976396 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.976264 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41f7e379-4acf-4b2c-a4c8-a1974d5f0f10-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-p6vw6\" (UID: \"41f7e379-4acf-4b2c-a4c8-a1974d5f0f10\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p6vw6" Jul 31 16:49:03.976920 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.976899 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/41f7e379-4acf-4b2c-a4c8-a1974d5f0f10-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-p6vw6\" (UID: \"41f7e379-4acf-4b2c-a4c8-a1974d5f0f10\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p6vw6" Jul 31 16:49:03.978547 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.978529 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/41f7e379-4acf-4b2c-a4c8-a1974d5f0f10-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-p6vw6\" (UID: \"41f7e379-4acf-4b2c-a4c8-a1974d5f0f10\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-p6vw6" Jul 31 16:49:03.986443 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.986421 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvs6d\" (UniqueName: \"kubernetes.io/projected/1b024a5e-5d58-4ee0-bdd3-8bc7c7eccd34-kube-api-access-vvs6d\") pod \"volume-data-source-validator-5b8776669-f8zs6\" (UID: \"1b024a5e-5d58-4ee0-bdd3-8bc7c7eccd34\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-f8zs6" Jul 31 16:49:03.987999 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:03.987981 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjdqt\" (UniqueName: \"kubernetes.io/projected/023177fe-233f-4e8e-b1eb-906b0c21a7af-kube-api-access-tjdqt\") pod \"network-check-source-65bdbbff45-pnlnq\" (UID: \"023177fe-233f-4e8e-b1eb-906b0c21a7af\") " pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pnlnq" Jul 31 16:49:04.065829 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:04.065795 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-f8zs6" Jul 31 16:49:04.072111 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:04.072079 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pnlnq" Jul 31 16:49:04.077346 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:04.077317 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a0fee27-1fbf-40f9-8c1a-0cade39d28f3-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-hgcf4\" (UID: \"4a0fee27-1fbf-40f9-8c1a-0cade39d28f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-hgcf4" Jul 31 16:49:04.077568 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:04.077551 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsxt7\" (UniqueName: \"kubernetes.io/projected/4a0fee27-1fbf-40f9-8c1a-0cade39d28f3-kube-api-access-tsxt7\") pod \"cluster-samples-operator-559cbf5745-hgcf4\" (UID: \"4a0fee27-1fbf-40f9-8c1a-0cade39d28f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-hgcf4" Jul 31 16:49:04.079414 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:04.079385 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-p6vw6" Jul 31 16:49:04.079882 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:04.079852 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4a0fee27-1fbf-40f9-8c1a-0cade39d28f3-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-hgcf4\" (UID: \"4a0fee27-1fbf-40f9-8c1a-0cade39d28f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-hgcf4" Jul 31 16:49:04.087127 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:04.087098 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsxt7\" (UniqueName: \"kubernetes.io/projected/4a0fee27-1fbf-40f9-8c1a-0cade39d28f3-kube-api-access-tsxt7\") pod \"cluster-samples-operator-559cbf5745-hgcf4\" (UID: \"4a0fee27-1fbf-40f9-8c1a-0cade39d28f3\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-hgcf4" Jul 31 16:49:04.188649 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:04.188617 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-hgcf4" Jul 31 16:49:04.211591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:04.211562 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-f8zs6"] Jul 31 16:49:04.214251 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:49:04.214225 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b024a5e_5d58_4ee0_bdd3_8bc7c7eccd34.slice/crio-67161d1f2e0312d84d2eecfa78861395b941541eeac70409c6de69ad0f15e6ff WatchSource:0}: Error finding container 67161d1f2e0312d84d2eecfa78861395b941541eeac70409c6de69ad0f15e6ff: Status 404 returned error can't find the container with id 67161d1f2e0312d84d2eecfa78861395b941541eeac70409c6de69ad0f15e6ff Jul 31 16:49:04.332780 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:04.332592 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-hgcf4"] Jul 31 16:49:04.337267 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:04.337236 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-f8zs6" event={"ID":"1b024a5e-5d58-4ee0-bdd3-8bc7c7eccd34","Type":"ContainerStarted","Data":"67161d1f2e0312d84d2eecfa78861395b941541eeac70409c6de69ad0f15e6ff"} Jul 31 16:49:04.459557 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:04.459501 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-65bdbbff45-pnlnq"] Jul 31 16:49:04.460674 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:04.460651 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-p6vw6"] Jul 31 16:49:04.461436 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:49:04.461401 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f7e379_4acf_4b2c_a4c8_a1974d5f0f10.slice/crio-5e398cf41d09e67bd3fa9bdf9a487b1281664d4df49bda19c3f861d880c080e3 WatchSource:0}: Error finding container 5e398cf41d09e67bd3fa9bdf9a487b1281664d4df49bda19c3f861d880c080e3: Status 404 returned error can't find the container with id 5e398cf41d09e67bd3fa9bdf9a487b1281664d4df49bda19c3f861d880c080e3 Jul 31 16:49:04.462102 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:49:04.462080 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023177fe_233f_4e8e_b1eb_906b0c21a7af.slice/crio-65f91dca097c2a0cfdb65212e63e81d3d9a299018e34d18a07523a67a1ab1785 WatchSource:0}: Error finding container 65f91dca097c2a0cfdb65212e63e81d3d9a299018e34d18a07523a67a1ab1785: Status 404 returned error can't find the container with id 65f91dca097c2a0cfdb65212e63e81d3d9a299018e34d18a07523a67a1ab1785 Jul 31 16:49:05.342028 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:05.341998 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-hgcf4" event={"ID":"4a0fee27-1fbf-40f9-8c1a-0cade39d28f3","Type":"ContainerStarted","Data":"ea23542703afaa8bbfa5ed7f235b35dc018db3b53cda9ce9f6e9216754f1e17e"} Jul 31 16:49:05.343281 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:05.343255 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-p6vw6" event={"ID":"41f7e379-4acf-4b2c-a4c8-a1974d5f0f10","Type":"ContainerStarted","Data":"5e398cf41d09e67bd3fa9bdf9a487b1281664d4df49bda19c3f861d880c080e3"} Jul 31 16:49:05.344928 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:05.344905 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pnlnq" event={"ID":"023177fe-233f-4e8e-b1eb-906b0c21a7af","Type":"ContainerStarted","Data":"2d2eff8075dfacc4e115a839ba5fd6bc9326c9e980bb4e5320abb7028e506945"} Jul 31 16:49:05.345023 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:05.344947 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pnlnq" event={"ID":"023177fe-233f-4e8e-b1eb-906b0c21a7af","Type":"ContainerStarted","Data":"65f91dca097c2a0cfdb65212e63e81d3d9a299018e34d18a07523a67a1ab1785"} Jul 31 16:49:05.365634 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:05.365561 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-65bdbbff45-pnlnq" podStartSLOduration=2.365541132 podStartE2EDuration="2.365541132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:49:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:49:05.365293399 +0000 UTC m=+125.136323708" watchObservedRunningTime="2026-07-31 16:49:05.365541132 +0000 UTC m=+125.136571441" Jul 31 16:49:06.351180 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:06.351138 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-f8zs6" event={"ID":"1b024a5e-5d58-4ee0-bdd3-8bc7c7eccd34","Type":"ContainerStarted","Data":"dfed1975e247e97301a27842e42536e2f207be949ba6b81f7a3a7979820f9bc9"} Jul 31 16:49:06.353134 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:06.353102 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-p6vw6" event={"ID":"41f7e379-4acf-4b2c-a4c8-a1974d5f0f10","Type":"ContainerStarted","Data":"f433973c4d3f424011f897c784c20dbae344cf6225f482436984ba474d6a2b52"} Jul 31 16:49:06.369101 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:06.369054 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-f8zs6" podStartSLOduration=2.259822902 podStartE2EDuration="3.3690382s" totalImagesPullingTime="1.109215298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:49:06.36708188 +0000 UTC m=+126.138112189" watchObservedRunningTime="2026-07-31 16:49:06.3690382 +0000 UTC m=+126.140068508" Jul 31 16:49:06.388848 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:06.388800 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-p6vw6" podStartSLOduration=2.013910871 podStartE2EDuration="3.388783715s" totalImagesPullingTime="1.374872844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:49:06.38860236 +0000 UTC m=+126.159632668" watchObservedRunningTime="2026-07-31 16:49:06.388783715 +0000 UTC m=+126.159814056" Jul 31 16:49:06.736682 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:06.736588 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-99v98"] Jul 31 16:49:06.738559 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:06.738536 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-99v98" Jul 31 16:49:06.741335 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:06.741312 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 31 16:49:06.741775 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:06.741745 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 31 16:49:06.741989 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:06.741972 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-pk29k\"" Jul 31 16:49:06.751787 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:06.751763 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-99v98"] Jul 31 16:49:06.899885 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:06.899845 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdbrf\" (UniqueName: \"kubernetes.io/projected/91150b92-736c-4657-9a02-d09f07c58e24-kube-api-access-bdbrf\") pod \"downloads-77c974ffcf-99v98\" (UID: \"91150b92-736c-4657-9a02-d09f07c58e24\") " pod="openshift-console/downloads-77c974ffcf-99v98" Jul 31 16:49:07.000267 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:07.000197 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdbrf\" (UniqueName: \"kubernetes.io/projected/91150b92-736c-4657-9a02-d09f07c58e24-kube-api-access-bdbrf\") pod \"downloads-77c974ffcf-99v98\" (UID: \"91150b92-736c-4657-9a02-d09f07c58e24\") " pod="openshift-console/downloads-77c974ffcf-99v98" Jul 31 16:49:07.009581 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:07.009558 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdbrf\" (UniqueName: \"kubernetes.io/projected/91150b92-736c-4657-9a02-d09f07c58e24-kube-api-access-bdbrf\") pod \"downloads-77c974ffcf-99v98\" (UID: \"91150b92-736c-4657-9a02-d09f07c58e24\") " pod="openshift-console/downloads-77c974ffcf-99v98" Jul 31 16:49:07.050070 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:07.050039 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-99v98" Jul 31 16:49:07.183176 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:07.183147 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-99v98"] Jul 31 16:49:07.187647 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:49:07.187615 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91150b92_736c_4657_9a02_d09f07c58e24.slice/crio-454ec67f33b58a8aac5e02b1cae694a06dbdbd8ef3f718b098bdc524a7ac2a3b WatchSource:0}: Error finding container 454ec67f33b58a8aac5e02b1cae694a06dbdbd8ef3f718b098bdc524a7ac2a3b: Status 404 returned error can't find the container with id 454ec67f33b58a8aac5e02b1cae694a06dbdbd8ef3f718b098bdc524a7ac2a3b Jul 31 16:49:07.357162 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:07.357128 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-99v98" event={"ID":"91150b92-736c-4657-9a02-d09f07c58e24","Type":"ContainerStarted","Data":"454ec67f33b58a8aac5e02b1cae694a06dbdbd8ef3f718b098bdc524a7ac2a3b"} Jul 31 16:49:07.358755 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:07.358727 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-hgcf4" event={"ID":"4a0fee27-1fbf-40f9-8c1a-0cade39d28f3","Type":"ContainerStarted","Data":"588ac13ca7961dd7c6743d6b1602509decdf5f5547673949775da838a62ee924"} Jul 31 16:49:07.358879 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:07.358773 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-hgcf4" event={"ID":"4a0fee27-1fbf-40f9-8c1a-0cade39d28f3","Type":"ContainerStarted","Data":"3e96be7eb45d59ed613cf38ef4a8e0c8d35e5a425dac0170199a8b9be9a705c5"} Jul 31 16:49:09.621316 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:09.621276 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs\") pod \"network-metrics-daemon-fmdcm\" (UID: \"74210898-48a8-42d3-a8f1-25708d2719cb\") " pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:49:09.623929 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:09.623902 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74210898-48a8-42d3-a8f1-25708d2719cb-metrics-certs\") pod \"network-metrics-daemon-fmdcm\" (UID: \"74210898-48a8-42d3-a8f1-25708d2719cb\") " pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:49:09.831866 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:09.831838 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bknw8\"" Jul 31 16:49:09.840129 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:09.840097 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fmdcm" Jul 31 16:49:09.982750 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:09.982640 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-hgcf4" podStartSLOduration=4.941807939 podStartE2EDuration="6.98261245s" totalImagesPullingTime="2.040804511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:49:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:49:07.380852777 +0000 UTC m=+127.151883084" watchObservedRunningTime="2026-07-31 16:49:09.98261245 +0000 UTC m=+129.753642759" Jul 31 16:49:09.983712 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:09.983679 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fmdcm"] Jul 31 16:49:09.986575 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:49:09.986539 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74210898_48a8_42d3_a8f1_25708d2719cb.slice/crio-3cc02d57e82da90662f9fda1272336c122e5a04683863f8878f5158b0feea5ab WatchSource:0}: Error finding container 3cc02d57e82da90662f9fda1272336c122e5a04683863f8878f5158b0feea5ab: Status 404 returned error can't find the container with id 3cc02d57e82da90662f9fda1272336c122e5a04683863f8878f5158b0feea5ab Jul 31 16:49:10.370162 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:10.370120 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fmdcm" event={"ID":"74210898-48a8-42d3-a8f1-25708d2719cb","Type":"ContainerStarted","Data":"3cc02d57e82da90662f9fda1272336c122e5a04683863f8878f5158b0feea5ab"} Jul 31 16:49:11.375641 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:11.375603 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fmdcm" event={"ID":"74210898-48a8-42d3-a8f1-25708d2719cb","Type":"ContainerStarted","Data":"0b1e874215ddc521d76f5e065fef6f7e8660f68eecf42b3174581a7e4f5a83e3"} Jul 31 16:49:11.376115 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:11.375666 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fmdcm" event={"ID":"74210898-48a8-42d3-a8f1-25708d2719cb","Type":"ContainerStarted","Data":"af3de3741ae3b5e94665ffe9502d734af1627879a47292398f52cbd3c17b18e6"} Jul 31 16:49:11.395965 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:11.395917 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fmdcm" podStartSLOduration=129.539219161 podStartE2EDuration="2m10.395901933s" totalImagesPullingTime="856.682772ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:47:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:49:11.394553538 +0000 UTC m=+131.165583847" watchObservedRunningTime="2026-07-31 16:49:11.395901933 +0000 UTC m=+131.166932242" Jul 31 16:49:12.726693 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:12.726654 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-g69ls"] Jul 31 16:49:12.729148 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:12.729122 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-g69ls" Jul 31 16:49:12.733543 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:12.733516 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xq9v8\"" Jul 31 16:49:12.734876 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:12.734848 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 31 16:49:12.757965 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:12.757932 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-g69ls"] Jul 31 16:49:12.844313 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:12.844277 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a4e97548-4437-43a2-a605-54570327a537-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-g69ls\" (UID: \"a4e97548-4437-43a2-a605-54570327a537\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-g69ls" Jul 31 16:49:12.945194 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:12.945156 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a4e97548-4437-43a2-a605-54570327a537-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-g69ls\" (UID: \"a4e97548-4437-43a2-a605-54570327a537\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-g69ls" Jul 31 16:49:12.948264 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:12.948237 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a4e97548-4437-43a2-a605-54570327a537-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-g69ls\" (UID: \"a4e97548-4437-43a2-a605-54570327a537\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-g69ls" Jul 31 16:49:13.040636 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:13.040409 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-g69ls" Jul 31 16:49:13.221311 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:13.221279 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-g69ls"] Jul 31 16:49:13.224997 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:49:13.224968 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4e97548_4437_43a2_a605_54570327a537.slice/crio-d5fab5513d82c2484871eca1dc1a1200b74d28f353c480d8b37e6f8e039c4df7 WatchSource:0}: Error finding container d5fab5513d82c2484871eca1dc1a1200b74d28f353c480d8b37e6f8e039c4df7: Status 404 returned error can't find the container with id d5fab5513d82c2484871eca1dc1a1200b74d28f353c480d8b37e6f8e039c4df7 Jul 31 16:49:13.385435 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:13.385348 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-g69ls" event={"ID":"a4e97548-4437-43a2-a605-54570327a537","Type":"ContainerStarted","Data":"d5fab5513d82c2484871eca1dc1a1200b74d28f353c480d8b37e6f8e039c4df7"} Jul 31 16:49:15.394225 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:15.394183 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-g69ls" event={"ID":"a4e97548-4437-43a2-a605-54570327a537","Type":"ContainerStarted","Data":"bc036a56ca9a9c15c1c6f8d49f98613096d6181f3e3166109cc27702403fa87a"} Jul 31 16:49:15.394694 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:15.394402 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-g69ls" Jul 31 16:49:15.400117 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:15.400085 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-g69ls" Jul 31 16:49:15.417490 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:15.417415 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-g69ls" podStartSLOduration=2.252753766 podStartE2EDuration="3.417394172s" totalImagesPullingTime="1.164640406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:49:15.416682278 +0000 UTC m=+135.187712587" watchObservedRunningTime="2026-07-31 16:49:15.417394172 +0000 UTC m=+135.188424480" Jul 31 16:49:21.280841 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.280809 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5bdhc"] Jul 31 16:49:21.287298 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.287274 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.290948 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.290926 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 31 16:49:21.291074 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.290930 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 31 16:49:21.291074 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.291027 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 31 16:49:21.291329 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.291281 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 31 16:49:21.291465 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.291332 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 31 16:49:21.292126 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.292105 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 31 16:49:21.292568 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.292551 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ch79x\"" Jul 31 16:49:21.411356 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.411321 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/76d2fdb8-6ade-44a2-933b-6a882947d6cc-node-exporter-wtmp\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.411551 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.411364 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76d2fdb8-6ade-44a2-933b-6a882947d6cc-metrics-client-ca\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.411551 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.411390 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/76d2fdb8-6ade-44a2-933b-6a882947d6cc-node-exporter-tls\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.411551 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.411426 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/76d2fdb8-6ade-44a2-933b-6a882947d6cc-node-exporter-textfile\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.411551 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.411465 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/76d2fdb8-6ade-44a2-933b-6a882947d6cc-root\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.411734 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.411565 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85qqg\" (UniqueName: \"kubernetes.io/projected/76d2fdb8-6ade-44a2-933b-6a882947d6cc-kube-api-access-85qqg\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.411734 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.411610 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76d2fdb8-6ade-44a2-933b-6a882947d6cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.411734 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.411639 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/76d2fdb8-6ade-44a2-933b-6a882947d6cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.411734 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.411665 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76d2fdb8-6ade-44a2-933b-6a882947d6cc-sys\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.512431 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.512394 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76d2fdb8-6ade-44a2-933b-6a882947d6cc-metrics-client-ca\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.512431 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.512432 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/76d2fdb8-6ade-44a2-933b-6a882947d6cc-node-exporter-tls\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.512698 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.512477 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/76d2fdb8-6ade-44a2-933b-6a882947d6cc-node-exporter-textfile\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.512698 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.512503 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/76d2fdb8-6ade-44a2-933b-6a882947d6cc-root\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.512698 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.512549 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85qqg\" (UniqueName: \"kubernetes.io/projected/76d2fdb8-6ade-44a2-933b-6a882947d6cc-kube-api-access-85qqg\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.512698 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.512576 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76d2fdb8-6ade-44a2-933b-6a882947d6cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.512698 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.512622 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/76d2fdb8-6ade-44a2-933b-6a882947d6cc-root\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.512982 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.512735 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/76d2fdb8-6ade-44a2-933b-6a882947d6cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.512982 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.512778 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76d2fdb8-6ade-44a2-933b-6a882947d6cc-sys\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.512982 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.512850 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/76d2fdb8-6ade-44a2-933b-6a882947d6cc-node-exporter-wtmp\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.512982 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.512931 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/76d2fdb8-6ade-44a2-933b-6a882947d6cc-node-exporter-textfile\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.513185 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.513010 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76d2fdb8-6ade-44a2-933b-6a882947d6cc-sys\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.513185 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.513027 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/76d2fdb8-6ade-44a2-933b-6a882947d6cc-node-exporter-wtmp\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.513185 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.513130 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/76d2fdb8-6ade-44a2-933b-6a882947d6cc-metrics-client-ca\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.513419 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.513393 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/76d2fdb8-6ade-44a2-933b-6a882947d6cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.515085 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.515060 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/76d2fdb8-6ade-44a2-933b-6a882947d6cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.515227 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.515209 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/76d2fdb8-6ade-44a2-933b-6a882947d6cc-node-exporter-tls\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.524173 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.524153 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85qqg\" (UniqueName: \"kubernetes.io/projected/76d2fdb8-6ade-44a2-933b-6a882947d6cc-kube-api-access-85qqg\") pod \"node-exporter-5bdhc\" (UID: \"76d2fdb8-6ade-44a2-933b-6a882947d6cc\") " pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:21.598249 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:21.598167 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5bdhc" Jul 31 16:49:22.280547 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.280515 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 16:49:22.284518 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.284492 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.287525 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.287499 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p6ns8\"" Jul 31 16:49:22.287667 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.287538 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 31 16:49:22.287667 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.287612 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 31 16:49:22.289531 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.289512 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 31 16:49:22.289643 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.289574 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 31 16:49:22.289820 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.289801 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 31 16:49:22.289916 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.289820 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 31 16:49:22.289916 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.289838 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 31 16:49:22.289916 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.289843 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 31 16:49:22.290677 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.290649 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 31 16:49:22.306495 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.306469 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 16:49:22.420653 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.420611 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f1f3782-516c-4bde-83fb-8876699043e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.420844 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.420665 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.420844 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.420708 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.420844 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.420729 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.420844 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.420754 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.420844 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.420775 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.420844 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.420811 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f1f3782-516c-4bde-83fb-8876699043e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.420844 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.420841 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f1f3782-516c-4bde-83fb-8876699043e6-config-out\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.421200 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.420863 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f1f3782-516c-4bde-83fb-8876699043e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.421200 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.420904 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-web-config\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.421200 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.420926 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljjpw\" (UniqueName: \"kubernetes.io/projected/5f1f3782-516c-4bde-83fb-8876699043e6-kube-api-access-ljjpw\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.421200 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.420958 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f1f3782-516c-4bde-83fb-8876699043e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.421200 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.421045 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.522281 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.522250 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f1f3782-516c-4bde-83fb-8876699043e6-config-out\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.522473 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.522292 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f1f3782-516c-4bde-83fb-8876699043e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.522473 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.522332 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-web-config\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.522473 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.522354 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljjpw\" (UniqueName: \"kubernetes.io/projected/5f1f3782-516c-4bde-83fb-8876699043e6-kube-api-access-ljjpw\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.522473 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.522384 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f1f3782-516c-4bde-83fb-8876699043e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.522473 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.522472 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.522860 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.522500 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f1f3782-516c-4bde-83fb-8876699043e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.522860 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.522545 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.522860 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.522580 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.522860 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.522606 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.522860 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.522637 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.522860 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.522661 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.522860 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.522697 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f1f3782-516c-4bde-83fb-8876699043e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.522860 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:49:22.522716 2586 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 31 16:49:22.522860 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:49:22.522783 2586 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-main-tls podName:5f1f3782-516c-4bde-83fb-8876699043e6 nodeName:}" failed. No retries permitted until 2026-07-31 16:49:23.022761874 +0000 UTC m=+142.793792180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "5f1f3782-516c-4bde-83fb-8876699043e6") : secret "alertmanager-main-tls" not found Jul 31 16:49:22.523344 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.523016 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f1f3782-516c-4bde-83fb-8876699043e6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.523440 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.523400 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f1f3782-516c-4bde-83fb-8876699043e6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.523535 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.523491 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f1f3782-516c-4bde-83fb-8876699043e6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.526207 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.526159 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f1f3782-516c-4bde-83fb-8876699043e6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.526322 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.526268 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f1f3782-516c-4bde-83fb-8876699043e6-config-out\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.526322 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.526312 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.526440 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.526390 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.526440 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.526402 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.527279 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.527253 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-web-config\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.527389 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.527260 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.527891 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.527871 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:22.532164 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:22.532111 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljjpw\" (UniqueName: \"kubernetes.io/projected/5f1f3782-516c-4bde-83fb-8876699043e6-kube-api-access-ljjpw\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:23.027824 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:23.027788 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:23.030393 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:23.030366 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:23.195835 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:23.195798 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:49:24.224351 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:49:24.224309 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76d2fdb8_6ade_44a2_933b_6a882947d6cc.slice/crio-ce9e92db590feef938c8ebe1527b06b33f4d0dcebe75a1d561b55bba820fc646 WatchSource:0}: Error finding container ce9e92db590feef938c8ebe1527b06b33f4d0dcebe75a1d561b55bba820fc646: Status 404 returned error can't find the container with id ce9e92db590feef938c8ebe1527b06b33f4d0dcebe75a1d561b55bba820fc646 Jul 31 16:49:24.368922 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:24.368895 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 16:49:24.370377 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:49:24.370352 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f1f3782_516c_4bde_83fb_8876699043e6.slice/crio-0fe2bd6133e5c22343fbd9d88cd3eec7a5cf0b2a83a684b288bc05771b01b33a WatchSource:0}: Error finding container 0fe2bd6133e5c22343fbd9d88cd3eec7a5cf0b2a83a684b288bc05771b01b33a: Status 404 returned error can't find the container with id 0fe2bd6133e5c22343fbd9d88cd3eec7a5cf0b2a83a684b288bc05771b01b33a Jul 31 16:49:24.429002 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:24.428963 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-99v98" event={"ID":"91150b92-736c-4657-9a02-d09f07c58e24","Type":"ContainerStarted","Data":"d34eaa42d88a9f5f196be19f336121c569a677d679f5ae3371888aaa59c04998"} Jul 31 16:49:24.429176 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:24.429136 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-99v98" Jul 31 16:49:24.430307 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:24.430276 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5bdhc" event={"ID":"76d2fdb8-6ade-44a2-933b-6a882947d6cc","Type":"ContainerStarted","Data":"ce9e92db590feef938c8ebe1527b06b33f4d0dcebe75a1d561b55bba820fc646"} Jul 31 16:49:24.430827 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:24.430800 2586 patch_prober.go:28] interesting pod/downloads-77c974ffcf-99v98 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.16:8080/\": dial tcp 10.132.0.16:8080: connect: connection refused" start-of-body= Jul 31 16:49:24.430945 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:24.430859 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-77c974ffcf-99v98" podUID="91150b92-736c-4657-9a02-d09f07c58e24" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.16:8080/\": dial tcp 10.132.0.16:8080: connect: connection refused" Jul 31 16:49:24.431418 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:24.431398 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f3782-516c-4bde-83fb-8876699043e6","Type":"ContainerStarted","Data":"0fe2bd6133e5c22343fbd9d88cd3eec7a5cf0b2a83a684b288bc05771b01b33a"} Jul 31 16:49:24.450814 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:24.450765 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-99v98" podStartSLOduration=1.325679392 podStartE2EDuration="18.450750444s" totalImagesPullingTime="17.125071052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:49:24.450064692 +0000 UTC m=+144.221095001" watchObservedRunningTime="2026-07-31 16:49:24.450750444 +0000 UTC m=+144.221780752" Jul 31 16:49:25.438932 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.438859 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5bdhc" event={"ID":"76d2fdb8-6ade-44a2-933b-6a882947d6cc","Type":"ContainerStarted","Data":"b94c4773ac0e3f80a04ffff908caee1aa71e8bd0095e3c6cd3c3f34e3e3d0d35"} Jul 31 16:49:25.452258 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.452192 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-99v98" Jul 31 16:49:25.537334 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.535908 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6cc4986db8-ggklp"] Jul 31 16:49:25.541603 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.540787 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.546052 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.544110 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 31 16:49:25.546052 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.544382 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-chjd6cblkufg1\"" Jul 31 16:49:25.546052 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.544629 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 31 16:49:25.546052 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.545296 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rlttk\"" Jul 31 16:49:25.546052 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.545515 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 31 16:49:25.546052 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.545722 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 31 16:49:25.552421 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.549502 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dd7fe337-da0b-4e48-8773-091cbaf32cc5-audit-log\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.552421 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.549565 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd7fe337-da0b-4e48-8773-091cbaf32cc5-client-ca-bundle\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.552421 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.549604 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd7fe337-da0b-4e48-8773-091cbaf32cc5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.552421 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.549646 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dd7fe337-da0b-4e48-8773-091cbaf32cc5-metrics-server-audit-profiles\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.552421 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.549672 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dd7fe337-da0b-4e48-8773-091cbaf32cc5-secret-metrics-server-client-certs\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.552421 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.549697 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dd7fe337-da0b-4e48-8773-091cbaf32cc5-secret-metrics-server-tls\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.552421 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.549721 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2fhm\" (UniqueName: \"kubernetes.io/projected/dd7fe337-da0b-4e48-8773-091cbaf32cc5-kube-api-access-s2fhm\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.556736 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.556340 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6cc4986db8-ggklp"] Jul 31 16:49:25.650112 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.650071 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd7fe337-da0b-4e48-8773-091cbaf32cc5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.650270 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.650134 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dd7fe337-da0b-4e48-8773-091cbaf32cc5-metrics-server-audit-profiles\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.650270 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.650164 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dd7fe337-da0b-4e48-8773-091cbaf32cc5-secret-metrics-server-client-certs\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.650270 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.650184 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dd7fe337-da0b-4e48-8773-091cbaf32cc5-secret-metrics-server-tls\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.650270 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.650201 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2fhm\" (UniqueName: \"kubernetes.io/projected/dd7fe337-da0b-4e48-8773-091cbaf32cc5-kube-api-access-s2fhm\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.650848 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.650819 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dd7fe337-da0b-4e48-8773-091cbaf32cc5-audit-log\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.650979 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.650875 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd7fe337-da0b-4e48-8773-091cbaf32cc5-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.650979 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.650901 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd7fe337-da0b-4e48-8773-091cbaf32cc5-client-ca-bundle\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.651222 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.651197 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dd7fe337-da0b-4e48-8773-091cbaf32cc5-metrics-server-audit-profiles\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.651585 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.651539 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dd7fe337-da0b-4e48-8773-091cbaf32cc5-audit-log\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.653302 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.653277 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dd7fe337-da0b-4e48-8773-091cbaf32cc5-secret-metrics-server-client-certs\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.653697 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.653674 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dd7fe337-da0b-4e48-8773-091cbaf32cc5-client-ca-bundle\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.653816 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.653795 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dd7fe337-da0b-4e48-8773-091cbaf32cc5-secret-metrics-server-tls\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.665012 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.664988 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2fhm\" (UniqueName: \"kubernetes.io/projected/dd7fe337-da0b-4e48-8773-091cbaf32cc5-kube-api-access-s2fhm\") pod \"metrics-server-6cc4986db8-ggklp\" (UID: \"dd7fe337-da0b-4e48-8773-091cbaf32cc5\") " pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:25.860613 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:25.860568 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:26.053818 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.053739 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6cc4986db8-ggklp"] Jul 31 16:49:26.058167 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:49:26.058132 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd7fe337_da0b_4e48_8773_091cbaf32cc5.slice/crio-c3707da3db81377a66335bf7969f48530d1b9b409190fe5d21094ff2e68ce308 WatchSource:0}: Error finding container c3707da3db81377a66335bf7969f48530d1b9b409190fe5d21094ff2e68ce308: Status 404 returned error can't find the container with id c3707da3db81377a66335bf7969f48530d1b9b409190fe5d21094ff2e68ce308 Jul 31 16:49:26.248513 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.248421 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75c6889569-9nvfx"] Jul 31 16:49:26.248736 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:49:26.248708 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-75c6889569-9nvfx" podUID="e0428e92-6379-4b17-9cec-b8b46368d631" Jul 31 16:49:26.443509 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.443440 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" event={"ID":"dd7fe337-da0b-4e48-8773-091cbaf32cc5","Type":"ContainerStarted","Data":"c3707da3db81377a66335bf7969f48530d1b9b409190fe5d21094ff2e68ce308"} Jul 31 16:49:26.445345 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.445312 2586 generic.go:356] "Generic (PLEG): container finished" podID="76d2fdb8-6ade-44a2-933b-6a882947d6cc" containerID="b94c4773ac0e3f80a04ffff908caee1aa71e8bd0095e3c6cd3c3f34e3e3d0d35" exitCode=0 Jul 31 16:49:26.445494 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.445408 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5bdhc" event={"ID":"76d2fdb8-6ade-44a2-933b-6a882947d6cc","Type":"ContainerDied","Data":"b94c4773ac0e3f80a04ffff908caee1aa71e8bd0095e3c6cd3c3f34e3e3d0d35"} Jul 31 16:49:26.447262 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.447238 2586 generic.go:356] "Generic (PLEG): container finished" podID="5f1f3782-516c-4bde-83fb-8876699043e6" containerID="6bb3551aa3799aecbc1059e0633abe76563247fdca607b4513101cd245cdb581" exitCode=0 Jul 31 16:49:26.447344 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.447298 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:49:26.447344 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.447320 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f3782-516c-4bde-83fb-8876699043e6","Type":"ContainerDied","Data":"6bb3551aa3799aecbc1059e0633abe76563247fdca607b4513101cd245cdb581"} Jul 31 16:49:26.488108 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.488080 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:49:26.558827 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.558790 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fwwt\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-kube-api-access-6fwwt\") pod \"e0428e92-6379-4b17-9cec-b8b46368d631\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " Jul 31 16:49:26.559008 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.558841 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0428e92-6379-4b17-9cec-b8b46368d631-trusted-ca\") pod \"e0428e92-6379-4b17-9cec-b8b46368d631\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " Jul 31 16:49:26.559097 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.559071 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0428e92-6379-4b17-9cec-b8b46368d631-installation-pull-secrets\") pod \"e0428e92-6379-4b17-9cec-b8b46368d631\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " Jul 31 16:49:26.559157 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.559145 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0428e92-6379-4b17-9cec-b8b46368d631-ca-trust-extracted\") pod \"e0428e92-6379-4b17-9cec-b8b46368d631\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " Jul 31 16:49:26.559210 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.559196 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-bound-sa-token\") pod \"e0428e92-6379-4b17-9cec-b8b46368d631\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " Jul 31 16:49:26.559263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.559229 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0428e92-6379-4b17-9cec-b8b46368d631-image-registry-private-configuration\") pod \"e0428e92-6379-4b17-9cec-b8b46368d631\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " Jul 31 16:49:26.559308 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.559260 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0428e92-6379-4b17-9cec-b8b46368d631-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e0428e92-6379-4b17-9cec-b8b46368d631" (UID: "e0428e92-6379-4b17-9cec-b8b46368d631"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 16:49:26.559308 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.559274 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0428e92-6379-4b17-9cec-b8b46368d631-registry-certificates\") pod \"e0428e92-6379-4b17-9cec-b8b46368d631\" (UID: \"e0428e92-6379-4b17-9cec-b8b46368d631\") " Jul 31 16:49:26.559404 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.559363 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0428e92-6379-4b17-9cec-b8b46368d631-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e0428e92-6379-4b17-9cec-b8b46368d631" (UID: "e0428e92-6379-4b17-9cec-b8b46368d631"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 16:49:26.559603 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.559579 2586 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0428e92-6379-4b17-9cec-b8b46368d631-trusted-ca\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:49:26.559674 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.559607 2586 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0428e92-6379-4b17-9cec-b8b46368d631-ca-trust-extracted\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:49:26.559674 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.559643 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0428e92-6379-4b17-9cec-b8b46368d631-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e0428e92-6379-4b17-9cec-b8b46368d631" (UID: "e0428e92-6379-4b17-9cec-b8b46368d631"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 16:49:26.562074 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.561988 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0428e92-6379-4b17-9cec-b8b46368d631-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e0428e92-6379-4b17-9cec-b8b46368d631" (UID: "e0428e92-6379-4b17-9cec-b8b46368d631"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:49:26.562272 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.562230 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e0428e92-6379-4b17-9cec-b8b46368d631" (UID: "e0428e92-6379-4b17-9cec-b8b46368d631"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 16:49:26.562435 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.562401 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-kube-api-access-6fwwt" (OuterVolumeSpecName: "kube-api-access-6fwwt") pod "e0428e92-6379-4b17-9cec-b8b46368d631" (UID: "e0428e92-6379-4b17-9cec-b8b46368d631"). InnerVolumeSpecName "kube-api-access-6fwwt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 16:49:26.562941 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.562910 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0428e92-6379-4b17-9cec-b8b46368d631-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e0428e92-6379-4b17-9cec-b8b46368d631" (UID: "e0428e92-6379-4b17-9cec-b8b46368d631"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:49:26.660619 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.660587 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fwwt\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-kube-api-access-6fwwt\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:49:26.660743 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.660624 2586 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0428e92-6379-4b17-9cec-b8b46368d631-installation-pull-secrets\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:49:26.660743 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.660639 2586 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-bound-sa-token\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:49:26.660743 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.660654 2586 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0428e92-6379-4b17-9cec-b8b46368d631-image-registry-private-configuration\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:49:26.660743 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:26.660669 2586 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0428e92-6379-4b17-9cec-b8b46368d631-registry-certificates\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:49:27.450393 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.448187 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 16:49:27.457023 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.456989 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c6889569-9nvfx" Jul 31 16:49:27.476380 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.476230 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 16:49:27.476380 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.476309 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5bdhc" event={"ID":"76d2fdb8-6ade-44a2-933b-6a882947d6cc","Type":"ContainerStarted","Data":"a47590437c25cb03e26c9a304724b570a5194de25de1ab0498ceeaa04cd714c6"} Jul 31 16:49:27.476380 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.476346 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5bdhc" event={"ID":"76d2fdb8-6ade-44a2-933b-6a882947d6cc","Type":"ContainerStarted","Data":"ff28625af6fd8a02d7a6376e72c346612b096310438c9ae65af7171a299c1e84"} Jul 31 16:49:27.476710 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.476488 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.482219 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.482191 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 31 16:49:27.482384 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.482291 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-df94rg3q3hfpm\"" Jul 31 16:49:27.482897 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.482605 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 31 16:49:27.482897 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.482693 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 31 16:49:27.485967 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.483069 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 31 16:49:27.485967 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.483303 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 31 16:49:27.485967 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.484555 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 31 16:49:27.485967 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.482612 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 31 16:49:27.485967 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.484746 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 31 16:49:27.485967 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.484957 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 31 16:49:27.485967 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.485112 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 31 16:49:27.485967 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.485249 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 31 16:49:27.485967 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.485314 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tl2tj\"" Jul 31 16:49:27.487640 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.487485 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5bdhc" podStartSLOduration=5.436433581 podStartE2EDuration="6.487465758s" totalImagesPullingTime="966.617882ms" totalInitContainerRuntime="84.414295ms" isStatefulPod=true podCreationTimestamp="2026-07-31 16:49:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:49:27.485714126 +0000 UTC m=+147.256744436" watchObservedRunningTime="2026-07-31 16:49:27.487465758 +0000 UTC m=+147.258496066" Jul 31 16:49:27.488088 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.487908 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 31 16:49:27.488193 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.488172 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 31 16:49:27.488262 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.488191 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 31 16:49:27.559818 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.559768 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75c6889569-9nvfx"] Jul 31 16:49:27.568862 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.568826 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-config\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569039 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.568869 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569039 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.568936 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569153 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569125 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569215 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569171 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-config-out\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569215 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569203 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569351 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569235 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569408 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569366 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569408 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569393 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569534 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569406 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75c6889569-9nvfx"] Jul 31 16:49:27.569594 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569530 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569594 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569567 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569691 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569594 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569691 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569643 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf7m2\" (UniqueName: \"kubernetes.io/projected/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-kube-api-access-qf7m2\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569794 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569719 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-web-config\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569794 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569764 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569897 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569796 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569897 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569868 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569996 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569898 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569996 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569929 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.569996 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.569953 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.672819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.670905 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.672819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.670957 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.672819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.670987 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.672819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671011 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf7m2\" (UniqueName: \"kubernetes.io/projected/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-kube-api-access-qf7m2\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.672819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671051 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-web-config\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.672819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671090 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.672819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671124 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.672819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671166 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.672819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671190 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.672819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671218 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.672819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671244 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.672819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671276 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-config\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.672819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671298 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.672819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671332 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.672819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671361 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.672819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671386 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-config-out\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.672819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671416 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.690208 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671466 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.690208 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671494 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.690208 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671519 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.690208 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.671581 2586 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0428e92-6379-4b17-9cec-b8b46368d631-registry-tls\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:49:27.690208 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.672336 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.690208 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.678283 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.690208 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.680163 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.690208 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.681536 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.690208 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.681575 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.690208 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.681589 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.697721 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.695703 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.697721 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.696880 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.701148 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.701010 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.718733 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.718662 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.719191 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.719168 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.719360 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.719340 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-config\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.722064 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.722005 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.722064 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.722006 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.722388 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.722366 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.722609 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.722591 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-config-out\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.723970 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.723949 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-web-config\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.724838 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.724018 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.726165 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.726146 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.726470 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.726197 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf7m2\" (UniqueName: \"kubernetes.io/projected/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-kube-api-access-qf7m2\") pod \"prometheus-k8s-0\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:27.796146 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:27.796107 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:28.040744 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:28.040707 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 16:49:28.044123 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:49:28.044096 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86baf0e1_cfc3_4c77_a37e_7fe55ba5a4d3.slice/crio-959f44a17105bc6aa6d1a316a99b6d0996aa7df18cd153c83c5c92802f271ad5 WatchSource:0}: Error finding container 959f44a17105bc6aa6d1a316a99b6d0996aa7df18cd153c83c5c92802f271ad5: Status 404 returned error can't find the container with id 959f44a17105bc6aa6d1a316a99b6d0996aa7df18cd153c83c5c92802f271ad5 Jul 31 16:49:28.464904 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:28.464801 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3","Type":"ContainerStarted","Data":"959f44a17105bc6aa6d1a316a99b6d0996aa7df18cd153c83c5c92802f271ad5"} Jul 31 16:49:28.722481 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:28.722387 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0428e92-6379-4b17-9cec-b8b46368d631" path="/var/lib/kubelet/pods/e0428e92-6379-4b17-9cec-b8b46368d631/volumes" Jul 31 16:49:29.472722 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:29.472693 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f3782-516c-4bde-83fb-8876699043e6","Type":"ContainerStarted","Data":"d0dd57f39bc6a9d77a7c20ab0f39182452e2b90704fba3c89612319c1e910027"} Jul 31 16:49:29.473103 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:29.472778 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f3782-516c-4bde-83fb-8876699043e6","Type":"ContainerStarted","Data":"5351f76604d6e6d0ca36b15f0040743ba31c76c698f9869767638f1219b7d5dd"} Jul 31 16:49:29.473103 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:29.472811 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f3782-516c-4bde-83fb-8876699043e6","Type":"ContainerStarted","Data":"c672a33323998281382031a2a0ce6eb2b4bbbb62e7014f294a1f56d1066c8b48"} Jul 31 16:49:29.474773 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:29.474744 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" event={"ID":"dd7fe337-da0b-4e48-8773-091cbaf32cc5","Type":"ContainerStarted","Data":"3dd1293a36d9e79f64ecb8982476c4df913ced07cc9f89435768680c45508d7b"} Jul 31 16:49:29.476485 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:29.476440 2586 generic.go:356] "Generic (PLEG): container finished" podID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerID="ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22" exitCode=0 Jul 31 16:49:29.476592 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:29.476534 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3","Type":"ContainerDied","Data":"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22"} Jul 31 16:49:29.494892 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:29.494134 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" podStartSLOduration=1.809610314 podStartE2EDuration="4.49411426s" totalImagesPullingTime="2.684503946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:49:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:49:29.492751558 +0000 UTC m=+149.263781866" watchObservedRunningTime="2026-07-31 16:49:29.49411426 +0000 UTC m=+149.265144569" Jul 31 16:49:30.487172 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:30.487075 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f3782-516c-4bde-83fb-8876699043e6","Type":"ContainerStarted","Data":"12568320a3c59117ca9a5aa5be52400a3d97e10bcf45117dd4ce293210742351"} Jul 31 16:49:30.488348 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:30.487217 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f3782-516c-4bde-83fb-8876699043e6","Type":"ContainerStarted","Data":"281a72f29a3807ceebe0d22f2a87814b666735eadfbeb8939f3ab544b95df08c"} Jul 31 16:49:31.497562 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:31.497513 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f3782-516c-4bde-83fb-8876699043e6","Type":"ContainerStarted","Data":"12edd0b9599595eaf07c8d654d64bf3b56a4189f711737dcd200dec2e25a1404"} Jul 31 16:49:31.556824 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:31.556705 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.23091214 podStartE2EDuration="9.556684608s" totalImagesPullingTime="5.306899967s" totalInitContainerRuntime="18.872501ms" isStatefulPod=false podCreationTimestamp="2026-07-31 16:49:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:49:31.553025643 +0000 UTC m=+151.324055953" watchObservedRunningTime="2026-07-31 16:49:31.556684608 +0000 UTC m=+151.327714917" Jul 31 16:49:34.514223 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:34.514181 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3","Type":"ContainerStarted","Data":"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7"} Jul 31 16:49:34.514709 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:34.514256 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3","Type":"ContainerStarted","Data":"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb"} Jul 31 16:49:36.525195 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:36.525161 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3","Type":"ContainerStarted","Data":"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af"} Jul 31 16:49:36.525623 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:36.525224 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3","Type":"ContainerStarted","Data":"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923"} Jul 31 16:49:36.525623 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:36.525251 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3","Type":"ContainerStarted","Data":"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae"} Jul 31 16:49:36.525623 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:36.525285 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3","Type":"ContainerStarted","Data":"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475"} Jul 31 16:49:37.558962 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:37.558905 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.229667417 podStartE2EDuration="10.558879124s" totalImagesPullingTime="6.300873625s" totalInitContainerRuntime="28.338082ms" isStatefulPod=false podCreationTimestamp="2026-07-31 16:49:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:49:37.55773024 +0000 UTC m=+157.328760542" watchObservedRunningTime="2026-07-31 16:49:37.558879124 +0000 UTC m=+157.329909411" Jul 31 16:49:37.604538 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:49:37.604498 2586 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fn9kg" podUID="4584e1cc-a4cd-4344-a274-416715cdc3e3" Jul 31 16:49:37.796926 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:37.796885 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:49:38.533048 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:38.533015 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fn9kg" Jul 31 16:49:42.511403 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:42.511363 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:49:42.513757 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:42.513732 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4584e1cc-a4cd-4344-a274-416715cdc3e3-metrics-tls\") pod \"dns-default-fn9kg\" (UID: \"4584e1cc-a4cd-4344-a274-416715cdc3e3\") " pod="openshift-dns/dns-default-fn9kg" Jul 31 16:49:42.736472 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:42.736422 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gmz7r\"" Jul 31 16:49:42.744523 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:42.744498 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fn9kg" Jul 31 16:49:42.902600 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:42.902475 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fn9kg"] Jul 31 16:49:42.905059 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:49:42.905032 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4584e1cc_a4cd_4344_a274_416715cdc3e3.slice/crio-399050981cbba6e1ec668d04fd9b1f4e253455b7eb77b8fe5be38e160e8828dc WatchSource:0}: Error finding container 399050981cbba6e1ec668d04fd9b1f4e253455b7eb77b8fe5be38e160e8828dc: Status 404 returned error can't find the container with id 399050981cbba6e1ec668d04fd9b1f4e253455b7eb77b8fe5be38e160e8828dc Jul 31 16:49:43.554236 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:43.554194 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fn9kg" event={"ID":"4584e1cc-a4cd-4344-a274-416715cdc3e3","Type":"ContainerStarted","Data":"399050981cbba6e1ec668d04fd9b1f4e253455b7eb77b8fe5be38e160e8828dc"} Jul 31 16:49:45.563979 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:45.563935 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fn9kg" event={"ID":"4584e1cc-a4cd-4344-a274-416715cdc3e3","Type":"ContainerStarted","Data":"de0ab0a8cadcc0ba843e022ecb5678904436e232046438996bbffcb2508c97ab"} Jul 31 16:49:45.564366 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:45.564039 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fn9kg" Jul 31 16:49:45.564366 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:45.564066 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fn9kg" event={"ID":"4584e1cc-a4cd-4344-a274-416715cdc3e3","Type":"ContainerStarted","Data":"509b0b03c8c519df46ad36edefb34dfce5f56d8d1c2495b1facab95df2175197"} Jul 31 16:49:45.583959 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:45.583906 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fn9kg" podStartSLOduration=129.332529362 podStartE2EDuration="2m11.583890657s" totalImagesPullingTime="2.251361295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:49:45.58182675 +0000 UTC m=+165.352857061" watchObservedRunningTime="2026-07-31 16:49:45.583890657 +0000 UTC m=+165.354920965" Jul 31 16:49:45.861347 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:45.861310 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:45.861553 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:45.861372 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:49:55.570531 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:49:55.570444 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fn9kg" Jul 31 16:50:03.489237 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:03.489200 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fn9kg_4584e1cc-a4cd-4344-a274-416715cdc3e3/dns/0.log" Jul 31 16:50:03.499253 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:03.499223 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fn9kg_4584e1cc-a4cd-4344-a274-416715cdc3e3/kube-rbac-proxy/0.log" Jul 31 16:50:04.058588 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:04.058557 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v6vm6_be2ba90e-7372-4e7f-bed4-ad0616ea12fd/dns-node-resolver/0.log" Jul 31 16:50:05.865925 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:05.865895 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:50:05.869733 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:05.869711 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6cc4986db8-ggklp" Jul 31 16:50:27.796671 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:27.796636 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:27.815819 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:27.815792 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:28.746768 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:28.746740 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:41.551180 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:41.551137 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 16:50:41.551765 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:41.551707 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="alertmanager" containerID="cri-o://c672a33323998281382031a2a0ce6eb2b4bbbb62e7014f294a1f56d1066c8b48" gracePeriod=120 Jul 31 16:50:41.552118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:41.552065 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="kube-rbac-proxy" containerID="cri-o://281a72f29a3807ceebe0d22f2a87814b666735eadfbeb8939f3ab544b95df08c" gracePeriod=120 Jul 31 16:50:41.552204 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:41.552156 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="kube-rbac-proxy-web" containerID="cri-o://d0dd57f39bc6a9d77a7c20ab0f39182452e2b90704fba3c89612319c1e910027" gracePeriod=120 Jul 31 16:50:41.552271 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:41.552248 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="prom-label-proxy" containerID="cri-o://12edd0b9599595eaf07c8d654d64bf3b56a4189f711737dcd200dec2e25a1404" gracePeriod=120 Jul 31 16:50:41.552323 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:41.552295 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="config-reloader" containerID="cri-o://5351f76604d6e6d0ca36b15f0040743ba31c76c698f9869767638f1219b7d5dd" gracePeriod=120 Jul 31 16:50:41.552380 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:41.552328 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="kube-rbac-proxy-metric" containerID="cri-o://12568320a3c59117ca9a5aa5be52400a3d97e10bcf45117dd4ce293210742351" gracePeriod=120 Jul 31 16:50:41.782230 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:41.782196 2586 generic.go:356] "Generic (PLEG): container finished" podID="5f1f3782-516c-4bde-83fb-8876699043e6" containerID="12edd0b9599595eaf07c8d654d64bf3b56a4189f711737dcd200dec2e25a1404" exitCode=0 Jul 31 16:50:41.782230 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:41.782222 2586 generic.go:356] "Generic (PLEG): container finished" podID="5f1f3782-516c-4bde-83fb-8876699043e6" containerID="281a72f29a3807ceebe0d22f2a87814b666735eadfbeb8939f3ab544b95df08c" exitCode=0 Jul 31 16:50:41.782230 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:41.782230 2586 generic.go:356] "Generic (PLEG): container finished" podID="5f1f3782-516c-4bde-83fb-8876699043e6" containerID="5351f76604d6e6d0ca36b15f0040743ba31c76c698f9869767638f1219b7d5dd" exitCode=0 Jul 31 16:50:41.782230 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:41.782235 2586 generic.go:356] "Generic (PLEG): container finished" podID="5f1f3782-516c-4bde-83fb-8876699043e6" containerID="c672a33323998281382031a2a0ce6eb2b4bbbb62e7014f294a1f56d1066c8b48" exitCode=0 Jul 31 16:50:41.782500 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:41.782271 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f3782-516c-4bde-83fb-8876699043e6","Type":"ContainerDied","Data":"12edd0b9599595eaf07c8d654d64bf3b56a4189f711737dcd200dec2e25a1404"} Jul 31 16:50:41.782500 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:41.782338 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f3782-516c-4bde-83fb-8876699043e6","Type":"ContainerDied","Data":"281a72f29a3807ceebe0d22f2a87814b666735eadfbeb8939f3ab544b95df08c"} Jul 31 16:50:41.782500 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:41.782364 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f3782-516c-4bde-83fb-8876699043e6","Type":"ContainerDied","Data":"5351f76604d6e6d0ca36b15f0040743ba31c76c698f9869767638f1219b7d5dd"} Jul 31 16:50:41.782500 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:41.782388 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f3782-516c-4bde-83fb-8876699043e6","Type":"ContainerDied","Data":"c672a33323998281382031a2a0ce6eb2b4bbbb62e7014f294a1f56d1066c8b48"} Jul 31 16:50:42.789059 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.789026 2586 generic.go:356] "Generic (PLEG): container finished" podID="5f1f3782-516c-4bde-83fb-8876699043e6" containerID="12568320a3c59117ca9a5aa5be52400a3d97e10bcf45117dd4ce293210742351" exitCode=0 Jul 31 16:50:42.789059 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.789052 2586 generic.go:356] "Generic (PLEG): container finished" podID="5f1f3782-516c-4bde-83fb-8876699043e6" containerID="d0dd57f39bc6a9d77a7c20ab0f39182452e2b90704fba3c89612319c1e910027" exitCode=0 Jul 31 16:50:42.789395 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.789093 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f3782-516c-4bde-83fb-8876699043e6","Type":"ContainerDied","Data":"12568320a3c59117ca9a5aa5be52400a3d97e10bcf45117dd4ce293210742351"} Jul 31 16:50:42.789395 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.789183 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f3782-516c-4bde-83fb-8876699043e6","Type":"ContainerDied","Data":"d0dd57f39bc6a9d77a7c20ab0f39182452e2b90704fba3c89612319c1e910027"} Jul 31 16:50:42.789395 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.789211 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f1f3782-516c-4bde-83fb-8876699043e6","Type":"ContainerDied","Data":"0fe2bd6133e5c22343fbd9d88cd3eec7a5cf0b2a83a684b288bc05771b01b33a"} Jul 31 16:50:42.789395 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.789244 2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fe2bd6133e5c22343fbd9d88cd3eec7a5cf0b2a83a684b288bc05771b01b33a" Jul 31 16:50:42.795511 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.795476 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:42.913250 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.913149 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-config-volume\") pod \"5f1f3782-516c-4bde-83fb-8876699043e6\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " Jul 31 16:50:42.913250 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.913196 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljjpw\" (UniqueName: \"kubernetes.io/projected/5f1f3782-516c-4bde-83fb-8876699043e6-kube-api-access-ljjpw\") pod \"5f1f3782-516c-4bde-83fb-8876699043e6\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " Jul 31 16:50:42.913250 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.913225 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-web-config\") pod \"5f1f3782-516c-4bde-83fb-8876699043e6\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " Jul 31 16:50:42.913250 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.913248 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-cluster-tls-config\") pod \"5f1f3782-516c-4bde-83fb-8876699043e6\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " Jul 31 16:50:42.913563 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.913433 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-main-tls\") pod \"5f1f3782-516c-4bde-83fb-8876699043e6\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " Jul 31 16:50:42.913563 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.913510 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy-web\") pod \"5f1f3782-516c-4bde-83fb-8876699043e6\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " Jul 31 16:50:42.913563 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.913539 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f1f3782-516c-4bde-83fb-8876699043e6-alertmanager-trusted-ca-bundle\") pod \"5f1f3782-516c-4bde-83fb-8876699043e6\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " Jul 31 16:50:42.913727 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.913569 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f1f3782-516c-4bde-83fb-8876699043e6-config-out\") pod \"5f1f3782-516c-4bde-83fb-8876699043e6\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " Jul 31 16:50:42.913727 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.913640 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f1f3782-516c-4bde-83fb-8876699043e6-metrics-client-ca\") pod \"5f1f3782-516c-4bde-83fb-8876699043e6\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " Jul 31 16:50:42.913727 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.913715 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5f1f3782-516c-4bde-83fb-8876699043e6\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " Jul 31 16:50:42.913882 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.913754 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy\") pod \"5f1f3782-516c-4bde-83fb-8876699043e6\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " Jul 31 16:50:42.913882 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.913788 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f1f3782-516c-4bde-83fb-8876699043e6-tls-assets\") pod \"5f1f3782-516c-4bde-83fb-8876699043e6\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " Jul 31 16:50:42.913882 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.913829 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f1f3782-516c-4bde-83fb-8876699043e6-alertmanager-main-db\") pod \"5f1f3782-516c-4bde-83fb-8876699043e6\" (UID: \"5f1f3782-516c-4bde-83fb-8876699043e6\") " Jul 31 16:50:42.914026 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.913936 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f1f3782-516c-4bde-83fb-8876699043e6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5f1f3782-516c-4bde-83fb-8876699043e6" (UID: "5f1f3782-516c-4bde-83fb-8876699043e6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 16:50:42.914410 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.914108 2586 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f1f3782-516c-4bde-83fb-8876699043e6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:42.915797 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.915768 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1f3782-516c-4bde-83fb-8876699043e6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5f1f3782-516c-4bde-83fb-8876699043e6" (UID: "5f1f3782-516c-4bde-83fb-8876699043e6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 16:50:42.915896 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.915778 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f1f3782-516c-4bde-83fb-8876699043e6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5f1f3782-516c-4bde-83fb-8876699043e6" (UID: "5f1f3782-516c-4bde-83fb-8876699043e6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 16:50:42.916431 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.916392 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5f1f3782-516c-4bde-83fb-8876699043e6" (UID: "5f1f3782-516c-4bde-83fb-8876699043e6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:50:42.916767 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.916736 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-config-volume" (OuterVolumeSpecName: "config-volume") pod "5f1f3782-516c-4bde-83fb-8876699043e6" (UID: "5f1f3782-516c-4bde-83fb-8876699043e6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:50:42.916940 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.916918 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5f1f3782-516c-4bde-83fb-8876699043e6" (UID: "5f1f3782-516c-4bde-83fb-8876699043e6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:50:42.917245 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.917215 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5f1f3782-516c-4bde-83fb-8876699043e6" (UID: "5f1f3782-516c-4bde-83fb-8876699043e6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:50:42.917358 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.917288 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f1f3782-516c-4bde-83fb-8876699043e6-kube-api-access-ljjpw" (OuterVolumeSpecName: "kube-api-access-ljjpw") pod "5f1f3782-516c-4bde-83fb-8876699043e6" (UID: "5f1f3782-516c-4bde-83fb-8876699043e6"). InnerVolumeSpecName "kube-api-access-ljjpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 16:50:42.917424 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.917397 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5f1f3782-516c-4bde-83fb-8876699043e6" (UID: "5f1f3782-516c-4bde-83fb-8876699043e6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:50:42.917764 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.917742 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f1f3782-516c-4bde-83fb-8876699043e6-config-out" (OuterVolumeSpecName: "config-out") pod "5f1f3782-516c-4bde-83fb-8876699043e6" (UID: "5f1f3782-516c-4bde-83fb-8876699043e6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 16:50:42.918064 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.918049 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f1f3782-516c-4bde-83fb-8876699043e6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5f1f3782-516c-4bde-83fb-8876699043e6" (UID: "5f1f3782-516c-4bde-83fb-8876699043e6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 16:50:42.920736 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.920717 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5f1f3782-516c-4bde-83fb-8876699043e6" (UID: "5f1f3782-516c-4bde-83fb-8876699043e6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:50:42.926638 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:42.926618 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-web-config" (OuterVolumeSpecName: "web-config") pod "5f1f3782-516c-4bde-83fb-8876699043e6" (UID: "5f1f3782-516c-4bde-83fb-8876699043e6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:50:43.015193 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.015150 2586 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f1f3782-516c-4bde-83fb-8876699043e6-config-out\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:43.015193 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.015193 2586 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f1f3782-516c-4bde-83fb-8876699043e6-metrics-client-ca\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:43.015193 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.015206 2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:43.015432 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.015232 2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:43.015432 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.015242 2586 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f1f3782-516c-4bde-83fb-8876699043e6-tls-assets\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:43.015432 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.015250 2586 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f1f3782-516c-4bde-83fb-8876699043e6-alertmanager-main-db\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:43.015432 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.015258 2586 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-config-volume\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:43.015432 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.015274 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljjpw\" (UniqueName: \"kubernetes.io/projected/5f1f3782-516c-4bde-83fb-8876699043e6-kube-api-access-ljjpw\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:43.015432 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.015285 2586 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-web-config\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:43.015432 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.015293 2586 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-cluster-tls-config\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:43.015432 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.015301 2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-main-tls\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:43.015432 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.015309 2586 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f1f3782-516c-4bde-83fb-8876699043e6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:43.792803 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.792751 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:43.816409 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.816372 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 16:50:43.821077 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.821046 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 16:50:43.849663 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.849631 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 16:50:43.849921 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.849909 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="kube-rbac-proxy-web" Jul 31 16:50:43.849968 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.849922 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="kube-rbac-proxy-web" Jul 31 16:50:43.849968 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.849936 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="kube-rbac-proxy" Jul 31 16:50:43.849968 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.849943 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="kube-rbac-proxy" Jul 31 16:50:43.849968 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.849952 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="prom-label-proxy" Jul 31 16:50:43.849968 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.849958 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="prom-label-proxy" Jul 31 16:50:43.849968 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.849965 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="alertmanager" Jul 31 16:50:43.849968 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.849970 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="alertmanager" Jul 31 16:50:43.850166 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.849976 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="config-reloader" Jul 31 16:50:43.850166 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.849981 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="config-reloader" Jul 31 16:50:43.850166 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.849992 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="init-config-reloader" Jul 31 16:50:43.850166 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.849997 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="init-config-reloader" Jul 31 16:50:43.850166 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.850003 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="kube-rbac-proxy-metric" Jul 31 16:50:43.850166 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.850008 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="kube-rbac-proxy-metric" Jul 31 16:50:43.850166 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.850054 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="kube-rbac-proxy" Jul 31 16:50:43.850166 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.850061 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="config-reloader" Jul 31 16:50:43.850166 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.850069 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="kube-rbac-proxy-metric" Jul 31 16:50:43.850166 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.850074 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="prom-label-proxy" Jul 31 16:50:43.850166 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.850081 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="alertmanager" Jul 31 16:50:43.850166 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.850086 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" containerName="kube-rbac-proxy-web" Jul 31 16:50:43.852987 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.852970 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:43.855818 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.855792 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 31 16:50:43.855818 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.855793 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 31 16:50:43.856038 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.855793 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-p6ns8\"" Jul 31 16:50:43.856038 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.855823 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 31 16:50:43.856137 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.856115 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 31 16:50:43.856190 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.856115 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 31 16:50:43.856540 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.856519 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 31 16:50:43.856758 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.856576 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 31 16:50:43.856758 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.856579 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 31 16:50:43.861571 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.861554 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 31 16:50:43.869345 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.869323 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 16:50:43.921725 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.921656 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:43.921725 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.921692 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:43.921725 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.921712 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25212d4f-a10b-4ef5-894d-a782a6fab10c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:43.921909 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.921734 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/25212d4f-a10b-4ef5-894d-a782a6fab10c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:43.921909 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.921786 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-web-config\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:43.921909 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.921838 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:43.921909 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.921880 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:43.921909 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.921900 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:43.922060 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.921922 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25212d4f-a10b-4ef5-894d-a782a6fab10c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:43.922060 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.921959 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/25212d4f-a10b-4ef5-894d-a782a6fab10c-config-out\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:43.922060 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.921989 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8gs6\" (UniqueName: \"kubernetes.io/projected/25212d4f-a10b-4ef5-894d-a782a6fab10c-kube-api-access-h8gs6\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:43.922060 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.922017 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/25212d4f-a10b-4ef5-894d-a782a6fab10c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:43.922060 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:43.922043 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-config-volume\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.022999 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.022957 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.023170 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.023008 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.023170 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.023040 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25212d4f-a10b-4ef5-894d-a782a6fab10c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.023170 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.023056 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/25212d4f-a10b-4ef5-894d-a782a6fab10c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.023170 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.023075 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-web-config\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.023170 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.023097 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.023360 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.023212 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.023360 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.023247 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.023360 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.023283 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25212d4f-a10b-4ef5-894d-a782a6fab10c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.023360 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.023308 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/25212d4f-a10b-4ef5-894d-a782a6fab10c-config-out\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.023360 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.023341 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8gs6\" (UniqueName: \"kubernetes.io/projected/25212d4f-a10b-4ef5-894d-a782a6fab10c-kube-api-access-h8gs6\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.023626 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.023374 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/25212d4f-a10b-4ef5-894d-a782a6fab10c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.023626 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.023415 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-config-volume\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.023626 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.023564 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/25212d4f-a10b-4ef5-894d-a782a6fab10c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.024575 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.024548 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25212d4f-a10b-4ef5-894d-a782a6fab10c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.026215 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.026186 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.026215 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.026198 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.026401 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.026270 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.026486 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.026410 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-web-config\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.026725 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.026700 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-config-volume\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.026833 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.026752 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.026833 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.026816 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25212d4f-a10b-4ef5-894d-a782a6fab10c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.027185 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.027157 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/25212d4f-a10b-4ef5-894d-a782a6fab10c-config-out\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.027618 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.027597 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/25212d4f-a10b-4ef5-894d-a782a6fab10c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.028334 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.028317 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/25212d4f-a10b-4ef5-894d-a782a6fab10c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.034499 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.034482 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8gs6\" (UniqueName: \"kubernetes.io/projected/25212d4f-a10b-4ef5-894d-a782a6fab10c-kube-api-access-h8gs6\") pod \"alertmanager-main-0\" (UID: \"25212d4f-a10b-4ef5-894d-a782a6fab10c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.162460 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.162419 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 31 16:50:44.306164 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.306133 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 31 16:50:44.307404 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:50:44.307367 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25212d4f_a10b_4ef5_894d_a782a6fab10c.slice/crio-9262ce623abcfb4a422ff27143f6c03b25fb6c426941a30c900d528f5737f9c0 WatchSource:0}: Error finding container 9262ce623abcfb4a422ff27143f6c03b25fb6c426941a30c900d528f5737f9c0: Status 404 returned error can't find the container with id 9262ce623abcfb4a422ff27143f6c03b25fb6c426941a30c900d528f5737f9c0 Jul 31 16:50:44.721612 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.721574 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f1f3782-516c-4bde-83fb-8876699043e6" path="/var/lib/kubelet/pods/5f1f3782-516c-4bde-83fb-8876699043e6/volumes" Jul 31 16:50:44.797764 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.797726 2586 generic.go:356] "Generic (PLEG): container finished" podID="25212d4f-a10b-4ef5-894d-a782a6fab10c" containerID="e9af1d5c48883dd4c6bb15f6097d0a4fc3fc3127ab8611fd750af270a66071a5" exitCode=0 Jul 31 16:50:44.798214 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.797815 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25212d4f-a10b-4ef5-894d-a782a6fab10c","Type":"ContainerDied","Data":"e9af1d5c48883dd4c6bb15f6097d0a4fc3fc3127ab8611fd750af270a66071a5"} Jul 31 16:50:44.798214 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:44.797886 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25212d4f-a10b-4ef5-894d-a782a6fab10c","Type":"ContainerStarted","Data":"9262ce623abcfb4a422ff27143f6c03b25fb6c426941a30c900d528f5737f9c0"} Jul 31 16:50:45.589366 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.589329 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-796656dbd5-dblwd"] Jul 31 16:50:45.591779 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.591760 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.597035 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.597007 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 31 16:50:45.597202 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.597006 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 31 16:50:45.597510 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.597478 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 31 16:50:45.597639 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.597622 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-9cr5d\"" Jul 31 16:50:45.597707 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.597642 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 31 16:50:45.597707 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.597649 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 31 16:50:45.602604 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.602583 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 31 16:50:45.612521 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.612496 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-796656dbd5-dblwd"] Jul 31 16:50:45.636579 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.636550 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/431a14eb-d218-409d-9a07-2cde22ccda13-federate-client-tls\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.636750 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.636590 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/431a14eb-d218-409d-9a07-2cde22ccda13-metrics-client-ca\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.636750 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.636612 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/431a14eb-d218-409d-9a07-2cde22ccda13-telemeter-trusted-ca-bundle\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.636750 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.636647 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/431a14eb-d218-409d-9a07-2cde22ccda13-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.636750 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.636696 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/431a14eb-d218-409d-9a07-2cde22ccda13-serving-certs-ca-bundle\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.636750 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.636710 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/431a14eb-d218-409d-9a07-2cde22ccda13-secret-telemeter-client\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.636750 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.636728 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/431a14eb-d218-409d-9a07-2cde22ccda13-telemeter-client-tls\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.636750 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.636749 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsr5c\" (UniqueName: \"kubernetes.io/projected/431a14eb-d218-409d-9a07-2cde22ccda13-kube-api-access-bsr5c\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.737772 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.737741 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/431a14eb-d218-409d-9a07-2cde22ccda13-secret-telemeter-client\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.737772 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.737772 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/431a14eb-d218-409d-9a07-2cde22ccda13-telemeter-client-tls\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.738012 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.737794 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsr5c\" (UniqueName: \"kubernetes.io/projected/431a14eb-d218-409d-9a07-2cde22ccda13-kube-api-access-bsr5c\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.738012 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.737819 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/431a14eb-d218-409d-9a07-2cde22ccda13-federate-client-tls\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.738012 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.737933 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/431a14eb-d218-409d-9a07-2cde22ccda13-metrics-client-ca\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.738012 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.737971 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/431a14eb-d218-409d-9a07-2cde22ccda13-telemeter-trusted-ca-bundle\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.738206 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.738036 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/431a14eb-d218-409d-9a07-2cde22ccda13-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.738206 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.738089 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/431a14eb-d218-409d-9a07-2cde22ccda13-serving-certs-ca-bundle\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.738768 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.738740 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/431a14eb-d218-409d-9a07-2cde22ccda13-serving-certs-ca-bundle\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.738768 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.738765 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/431a14eb-d218-409d-9a07-2cde22ccda13-metrics-client-ca\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.738945 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.738912 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/431a14eb-d218-409d-9a07-2cde22ccda13-telemeter-trusted-ca-bundle\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.740599 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.740577 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/431a14eb-d218-409d-9a07-2cde22ccda13-federate-client-tls\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.740688 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.740597 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/431a14eb-d218-409d-9a07-2cde22ccda13-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.740771 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.740756 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/431a14eb-d218-409d-9a07-2cde22ccda13-telemeter-client-tls\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.741055 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.741038 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/431a14eb-d218-409d-9a07-2cde22ccda13-secret-telemeter-client\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.747674 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.747645 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsr5c\" (UniqueName: \"kubernetes.io/projected/431a14eb-d218-409d-9a07-2cde22ccda13-kube-api-access-bsr5c\") pod \"telemeter-client-796656dbd5-dblwd\" (UID: \"431a14eb-d218-409d-9a07-2cde22ccda13\") " pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.805752 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.805713 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25212d4f-a10b-4ef5-894d-a782a6fab10c","Type":"ContainerStarted","Data":"fbea8deb57980343822009373a52ef021d9da6cfd1482d79c12feb37af2782bb"} Jul 31 16:50:45.806196 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.805800 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25212d4f-a10b-4ef5-894d-a782a6fab10c","Type":"ContainerStarted","Data":"35735df64b069dcaa928f5a731690c99c8a9da5de912787fc48578dcc8c690e3"} Jul 31 16:50:45.806196 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.805846 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25212d4f-a10b-4ef5-894d-a782a6fab10c","Type":"ContainerStarted","Data":"dc4b17a75ef1dbc1a63a69b01cf3ac8887a1b780794dc59047cb3194a86cd9a7"} Jul 31 16:50:45.806196 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.805888 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25212d4f-a10b-4ef5-894d-a782a6fab10c","Type":"ContainerStarted","Data":"af957c2a2c3fb579e69abafb5e9cb1c08614f2698de99809cb669328c6621cb5"} Jul 31 16:50:45.806196 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.805927 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25212d4f-a10b-4ef5-894d-a782a6fab10c","Type":"ContainerStarted","Data":"3956a650e174faaa2ddf3a5792d1ab350f4aacfc137c43e09fbb2deadf062bc1"} Jul 31 16:50:45.806196 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.805971 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"25212d4f-a10b-4ef5-894d-a782a6fab10c","Type":"ContainerStarted","Data":"20f016fec227636a4213a6c3cd3f77406dae41fb812bb9bff75371f965381c51"} Jul 31 16:50:45.838845 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.838793 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.820625521 podStartE2EDuration="2.838776917s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.151396ms" isStatefulPod=false podCreationTimestamp="2026-07-31 16:50:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:50:45.836549618 +0000 UTC m=+225.607579926" watchObservedRunningTime="2026-07-31 16:50:45.838776917 +0000 UTC m=+225.609807425" Jul 31 16:50:45.901462 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.901376 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" Jul 31 16:50:45.908969 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.908939 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 16:50:45.909441 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.909252 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af" gracePeriod=600 Jul 31 16:50:45.909441 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.909252 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="kube-rbac-proxy" containerID="cri-o://e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923" gracePeriod=600 Jul 31 16:50:45.909441 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.909293 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="config-reloader" containerID="cri-o://639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7" gracePeriod=600 Jul 31 16:50:45.909441 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.909318 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="kube-rbac-proxy-web" containerID="cri-o://5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae" gracePeriod=600 Jul 31 16:50:45.909441 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.909370 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="prometheus" containerID="cri-o://86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb" gracePeriod=600 Jul 31 16:50:45.909441 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:45.909292 2586 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="thanos-sidecar" containerID="cri-o://9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475" gracePeriod=600 Jul 31 16:50:46.059801 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.056125 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-796656dbd5-dblwd"] Jul 31 16:50:46.060897 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:50:46.060864 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod431a14eb_d218_409d_9a07_2cde22ccda13.slice/crio-3d9ad0d637e0e350664f5be6592a5cb2bbb0eaeea5039cc72ea0f3d4a928fa8b WatchSource:0}: Error finding container 3d9ad0d637e0e350664f5be6592a5cb2bbb0eaeea5039cc72ea0f3d4a928fa8b: Status 404 returned error can't find the container with id 3d9ad0d637e0e350664f5be6592a5cb2bbb0eaeea5039cc72ea0f3d4a928fa8b Jul 31 16:50:46.152300 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.152240 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.241986 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.241955 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-2\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242156 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242008 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-trusted-ca-bundle\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242156 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242036 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-config-out\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242156 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242064 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-serving-certs-ca-bundle\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242156 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242096 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-kube-rbac-proxy\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242156 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242120 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-0\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242156 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242146 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-tls\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242476 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242195 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-thanos-prometheus-http-client-file\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242476 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242228 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242476 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242368 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-grpc-tls\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242476 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242401 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-tls-assets\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242476 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242429 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-1\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242476 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242400 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 16:50:46.242476 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242472 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-db\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242809 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242508 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qf7m2\" (UniqueName: \"kubernetes.io/projected/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-kube-api-access-qf7m2\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242809 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242545 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-metrics-client-ca\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242809 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242565 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 16:50:46.242809 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242582 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-kubelet-serving-ca-bundle\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242809 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242645 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242809 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242680 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-config\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.242809 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242711 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-web-config\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.243140 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242880 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-metrics-client-certs\") pod \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\" (UID: \"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3\") " Jul 31 16:50:46.243140 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.242923 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 16:50:46.243140 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.243118 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 16:50:46.243299 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.243151 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.243299 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.243173 2586 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.243299 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.243189 2586 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.244219 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.244067 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 16:50:46.244219 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.244183 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 16:50:46.244419 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.244389 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 31 16:50:46.245166 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.245134 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 16:50:46.246343 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.246199 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:50:46.246343 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.246226 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:50:46.246343 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.246285 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:50:46.246343 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.246318 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-config" (OuterVolumeSpecName: "config") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:50:46.246617 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.246522 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:50:46.246667 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.246622 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 16:50:46.246804 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.246783 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:50:46.246942 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.246918 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-config-out" (OuterVolumeSpecName: "config-out") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 31 16:50:46.247020 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.247002 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:50:46.247368 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.247355 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-kube-api-access-qf7m2" (OuterVolumeSpecName: "kube-api-access-qf7m2") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "kube-api-access-qf7m2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 16:50:46.247508 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.247488 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:50:46.256933 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.256913 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-web-config" (OuterVolumeSpecName: "web-config") pod "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" (UID: "86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 31 16:50:46.344365 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.344320 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-db\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.344365 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.344361 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qf7m2\" (UniqueName: \"kubernetes.io/projected/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-kube-api-access-qf7m2\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.344614 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.344377 2586 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-configmap-metrics-client-ca\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.344614 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.344392 2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.344614 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.344405 2586 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-config\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.344614 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.344443 2586 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-web-config\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.344614 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.344484 2586 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-metrics-client-certs\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.344614 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.344496 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.344614 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.344509 2586 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-config-out\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.344614 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.344521 2586 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-kube-rbac-proxy\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.344614 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.344532 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.344614 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.344546 2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.344614 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.344559 2586 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.344614 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.344572 2586 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.344614 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.344587 2586 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-secret-grpc-tls\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.344614 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.344599 2586 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-tls-assets\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.344614 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.344614 2586 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 16:50:46.812005 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.811967 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" event={"ID":"431a14eb-d218-409d-9a07-2cde22ccda13","Type":"ContainerStarted","Data":"3d9ad0d637e0e350664f5be6592a5cb2bbb0eaeea5039cc72ea0f3d4a928fa8b"} Jul 31 16:50:46.815928 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.815903 2586 generic.go:356] "Generic (PLEG): container finished" podID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerID="0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af" exitCode=0 Jul 31 16:50:46.815928 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.815924 2586 generic.go:356] "Generic (PLEG): container finished" podID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerID="e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923" exitCode=0 Jul 31 16:50:46.815928 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.815932 2586 generic.go:356] "Generic (PLEG): container finished" podID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerID="5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae" exitCode=0 Jul 31 16:50:46.816144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.815939 2586 generic.go:356] "Generic (PLEG): container finished" podID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerID="9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475" exitCode=0 Jul 31 16:50:46.816144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.815945 2586 generic.go:356] "Generic (PLEG): container finished" podID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerID="639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7" exitCode=0 Jul 31 16:50:46.816144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.815951 2586 generic.go:356] "Generic (PLEG): container finished" podID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerID="86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb" exitCode=0 Jul 31 16:50:46.816144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.815993 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3","Type":"ContainerDied","Data":"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af"} Jul 31 16:50:46.816144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.816064 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.816144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.816080 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3","Type":"ContainerDied","Data":"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923"} Jul 31 16:50:46.816144 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.816127 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3","Type":"ContainerDied","Data":"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae"} Jul 31 16:50:46.816467 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.816155 2586 scope.go:117] "RemoveContainer" containerID="0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af" Jul 31 16:50:46.816467 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.816167 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3","Type":"ContainerDied","Data":"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475"} Jul 31 16:50:46.816467 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.816202 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3","Type":"ContainerDied","Data":"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7"} Jul 31 16:50:46.816467 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.816235 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3","Type":"ContainerDied","Data":"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb"} Jul 31 16:50:46.816467 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.816265 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3","Type":"ContainerDied","Data":"959f44a17105bc6aa6d1a316a99b6d0996aa7df18cd153c83c5c92802f271ad5"} Jul 31 16:50:46.824832 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.824812 2586 scope.go:117] "RemoveContainer" containerID="e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923" Jul 31 16:50:46.833154 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.833134 2586 scope.go:117] "RemoveContainer" containerID="5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae" Jul 31 16:50:46.841225 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.841199 2586 scope.go:117] "RemoveContainer" containerID="9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475" Jul 31 16:50:46.842672 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.842650 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 16:50:46.849227 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.849213 2586 scope.go:117] "RemoveContainer" containerID="639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7" Jul 31 16:50:46.857940 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.857890 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 16:50:46.858582 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.858508 2586 scope.go:117] "RemoveContainer" containerID="86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb" Jul 31 16:50:46.867053 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.867022 2586 scope.go:117] "RemoveContainer" containerID="ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22" Jul 31 16:50:46.874476 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.874429 2586 scope.go:117] "RemoveContainer" containerID="0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af" Jul 31 16:50:46.874858 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:50:46.874826 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af\": container with ID starting with 0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af not found: ID does not exist" containerID="0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af" Jul 31 16:50:46.874942 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.874869 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af"} err="failed to get container status \"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af\": rpc error: code = NotFound desc = could not find container \"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af\": container with ID starting with 0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af not found: ID does not exist" Jul 31 16:50:46.874942 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.874908 2586 scope.go:117] "RemoveContainer" containerID="e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923" Jul 31 16:50:46.875214 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:50:46.875170 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923\": container with ID starting with e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923 not found: ID does not exist" containerID="e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923" Jul 31 16:50:46.875214 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.875203 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923"} err="failed to get container status \"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923\": rpc error: code = NotFound desc = could not find container \"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923\": container with ID starting with e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923 not found: ID does not exist" Jul 31 16:50:46.875384 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.875225 2586 scope.go:117] "RemoveContainer" containerID="5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae" Jul 31 16:50:46.875638 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:50:46.875620 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae\": container with ID starting with 5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae not found: ID does not exist" containerID="5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae" Jul 31 16:50:46.875721 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.875644 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae"} err="failed to get container status \"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae\": rpc error: code = NotFound desc = could not find container \"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae\": container with ID starting with 5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae not found: ID does not exist" Jul 31 16:50:46.875721 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.875663 2586 scope.go:117] "RemoveContainer" containerID="9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475" Jul 31 16:50:46.875904 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:50:46.875889 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475\": container with ID starting with 9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475 not found: ID does not exist" containerID="9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475" Jul 31 16:50:46.875961 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.875907 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475"} err="failed to get container status \"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475\": rpc error: code = NotFound desc = could not find container \"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475\": container with ID starting with 9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475 not found: ID does not exist" Jul 31 16:50:46.875961 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.875930 2586 scope.go:117] "RemoveContainer" containerID="639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7" Jul 31 16:50:46.876204 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:50:46.876172 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7\": container with ID starting with 639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7 not found: ID does not exist" containerID="639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7" Jul 31 16:50:46.876302 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.876200 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7"} err="failed to get container status \"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7\": rpc error: code = NotFound desc = could not find container \"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7\": container with ID starting with 639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7 not found: ID does not exist" Jul 31 16:50:46.876302 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.876222 2586 scope.go:117] "RemoveContainer" containerID="86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb" Jul 31 16:50:46.876518 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:50:46.876496 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb\": container with ID starting with 86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb not found: ID does not exist" containerID="86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb" Jul 31 16:50:46.876571 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.876524 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb"} err="failed to get container status \"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb\": rpc error: code = NotFound desc = could not find container \"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb\": container with ID starting with 86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb not found: ID does not exist" Jul 31 16:50:46.876571 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.876544 2586 scope.go:117] "RemoveContainer" containerID="ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22" Jul 31 16:50:46.876803 ip-10-0-140-127 kubenswrapper[2586]: E0731 16:50:46.876781 2586 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22\": container with ID starting with ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22 not found: ID does not exist" containerID="ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22" Jul 31 16:50:46.876890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.876807 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22"} err="failed to get container status \"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22\": rpc error: code = NotFound desc = could not find container \"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22\": container with ID starting with ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22 not found: ID does not exist" Jul 31 16:50:46.876890 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.876826 2586 scope.go:117] "RemoveContainer" containerID="0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af" Jul 31 16:50:46.877093 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.877068 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af"} err="failed to get container status \"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af\": rpc error: code = NotFound desc = could not find container \"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af\": container with ID starting with 0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af not found: ID does not exist" Jul 31 16:50:46.877175 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.877095 2586 scope.go:117] "RemoveContainer" containerID="e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923" Jul 31 16:50:46.877371 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.877329 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923"} err="failed to get container status \"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923\": rpc error: code = NotFound desc = could not find container \"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923\": container with ID starting with e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923 not found: ID does not exist" Jul 31 16:50:46.877371 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.877363 2586 scope.go:117] "RemoveContainer" containerID="5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae" Jul 31 16:50:46.877641 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.877619 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae"} err="failed to get container status \"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae\": rpc error: code = NotFound desc = could not find container \"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae\": container with ID starting with 5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae not found: ID does not exist" Jul 31 16:50:46.877732 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.877643 2586 scope.go:117] "RemoveContainer" containerID="9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475" Jul 31 16:50:46.877889 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.877866 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475"} err="failed to get container status \"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475\": rpc error: code = NotFound desc = could not find container \"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475\": container with ID starting with 9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475 not found: ID does not exist" Jul 31 16:50:46.877951 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.877891 2586 scope.go:117] "RemoveContainer" containerID="639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7" Jul 31 16:50:46.878150 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.878128 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7"} err="failed to get container status \"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7\": rpc error: code = NotFound desc = could not find container \"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7\": container with ID starting with 639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7 not found: ID does not exist" Jul 31 16:50:46.878150 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.878149 2586 scope.go:117] "RemoveContainer" containerID="86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb" Jul 31 16:50:46.878405 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.878388 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb"} err="failed to get container status \"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb\": rpc error: code = NotFound desc = could not find container \"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb\": container with ID starting with 86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb not found: ID does not exist" Jul 31 16:50:46.878485 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.878407 2586 scope.go:117] "RemoveContainer" containerID="ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22" Jul 31 16:50:46.878719 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.878686 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22"} err="failed to get container status \"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22\": rpc error: code = NotFound desc = could not find container \"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22\": container with ID starting with ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22 not found: ID does not exist" Jul 31 16:50:46.878776 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.878720 2586 scope.go:117] "RemoveContainer" containerID="0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af" Jul 31 16:50:46.878964 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.878946 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af"} err="failed to get container status \"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af\": rpc error: code = NotFound desc = could not find container \"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af\": container with ID starting with 0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af not found: ID does not exist" Jul 31 16:50:46.879028 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.878964 2586 scope.go:117] "RemoveContainer" containerID="e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923" Jul 31 16:50:46.879241 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.879209 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923"} err="failed to get container status \"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923\": rpc error: code = NotFound desc = could not find container \"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923\": container with ID starting with e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923 not found: ID does not exist" Jul 31 16:50:46.879318 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.879243 2586 scope.go:117] "RemoveContainer" containerID="5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae" Jul 31 16:50:46.879509 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.879488 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae"} err="failed to get container status \"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae\": rpc error: code = NotFound desc = could not find container \"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae\": container with ID starting with 5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae not found: ID does not exist" Jul 31 16:50:46.879587 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.879510 2586 scope.go:117] "RemoveContainer" containerID="9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475" Jul 31 16:50:46.879746 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.879728 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475"} err="failed to get container status \"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475\": rpc error: code = NotFound desc = could not find container \"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475\": container with ID starting with 9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475 not found: ID does not exist" Jul 31 16:50:46.879787 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.879747 2586 scope.go:117] "RemoveContainer" containerID="639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7" Jul 31 16:50:46.879975 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.879957 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7"} err="failed to get container status \"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7\": rpc error: code = NotFound desc = could not find container \"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7\": container with ID starting with 639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7 not found: ID does not exist" Jul 31 16:50:46.879975 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.879977 2586 scope.go:117] "RemoveContainer" containerID="86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb" Jul 31 16:50:46.880197 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.880180 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb"} err="failed to get container status \"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb\": rpc error: code = NotFound desc = could not find container \"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb\": container with ID starting with 86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb not found: ID does not exist" Jul 31 16:50:46.880263 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.880198 2586 scope.go:117] "RemoveContainer" containerID="ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22" Jul 31 16:50:46.880405 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.880379 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22"} err="failed to get container status \"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22\": rpc error: code = NotFound desc = could not find container \"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22\": container with ID starting with ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22 not found: ID does not exist" Jul 31 16:50:46.880405 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.880402 2586 scope.go:117] "RemoveContainer" containerID="0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af" Jul 31 16:50:46.880671 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.880649 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af"} err="failed to get container status \"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af\": rpc error: code = NotFound desc = could not find container \"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af\": container with ID starting with 0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af not found: ID does not exist" Jul 31 16:50:46.880727 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.880673 2586 scope.go:117] "RemoveContainer" containerID="e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923" Jul 31 16:50:46.880910 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.880891 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923"} err="failed to get container status \"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923\": rpc error: code = NotFound desc = could not find container \"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923\": container with ID starting with e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923 not found: ID does not exist" Jul 31 16:50:46.880976 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.880912 2586 scope.go:117] "RemoveContainer" containerID="5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae" Jul 31 16:50:46.881178 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.881153 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae"} err="failed to get container status \"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae\": rpc error: code = NotFound desc = could not find container \"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae\": container with ID starting with 5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae not found: ID does not exist" Jul 31 16:50:46.881178 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.881177 2586 scope.go:117] "RemoveContainer" containerID="9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475" Jul 31 16:50:46.881436 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.881404 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475"} err="failed to get container status \"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475\": rpc error: code = NotFound desc = could not find container \"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475\": container with ID starting with 9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475 not found: ID does not exist" Jul 31 16:50:46.881436 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.881430 2586 scope.go:117] "RemoveContainer" containerID="639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7" Jul 31 16:50:46.881686 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.881667 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7"} err="failed to get container status \"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7\": rpc error: code = NotFound desc = could not find container \"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7\": container with ID starting with 639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7 not found: ID does not exist" Jul 31 16:50:46.881733 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.881686 2586 scope.go:117] "RemoveContainer" containerID="86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb" Jul 31 16:50:46.882071 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.882025 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb"} err="failed to get container status \"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb\": rpc error: code = NotFound desc = could not find container \"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb\": container with ID starting with 86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb not found: ID does not exist" Jul 31 16:50:46.882164 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.882098 2586 scope.go:117] "RemoveContainer" containerID="ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22" Jul 31 16:50:46.882581 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.882461 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22"} err="failed to get container status \"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22\": rpc error: code = NotFound desc = could not find container \"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22\": container with ID starting with ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22 not found: ID does not exist" Jul 31 16:50:46.882581 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.882488 2586 scope.go:117] "RemoveContainer" containerID="0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af" Jul 31 16:50:46.882885 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.882812 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af"} err="failed to get container status \"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af\": rpc error: code = NotFound desc = could not find container \"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af\": container with ID starting with 0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af not found: ID does not exist" Jul 31 16:50:46.882885 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.882840 2586 scope.go:117] "RemoveContainer" containerID="e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923" Jul 31 16:50:46.883125 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.883092 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923"} err="failed to get container status \"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923\": rpc error: code = NotFound desc = could not find container \"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923\": container with ID starting with e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923 not found: ID does not exist" Jul 31 16:50:46.883125 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.883124 2586 scope.go:117] "RemoveContainer" containerID="5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae" Jul 31 16:50:46.883716 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.883694 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae"} err="failed to get container status \"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae\": rpc error: code = NotFound desc = could not find container \"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae\": container with ID starting with 5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae not found: ID does not exist" Jul 31 16:50:46.883716 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.883717 2586 scope.go:117] "RemoveContainer" containerID="9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475" Jul 31 16:50:46.883987 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.883963 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475"} err="failed to get container status \"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475\": rpc error: code = NotFound desc = could not find container \"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475\": container with ID starting with 9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475 not found: ID does not exist" Jul 31 16:50:46.883987 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.883987 2586 scope.go:117] "RemoveContainer" containerID="639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7" Jul 31 16:50:46.884236 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884210 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7"} err="failed to get container status \"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7\": rpc error: code = NotFound desc = could not find container \"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7\": container with ID starting with 639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7 not found: ID does not exist" Jul 31 16:50:46.884236 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884237 2586 scope.go:117] "RemoveContainer" containerID="86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb" Jul 31 16:50:46.884369 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884335 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 16:50:46.884514 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884491 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb"} err="failed to get container status \"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb\": rpc error: code = NotFound desc = could not find container \"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb\": container with ID starting with 86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb not found: ID does not exist" Jul 31 16:50:46.884570 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884517 2586 scope.go:117] "RemoveContainer" containerID="ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22" Jul 31 16:50:46.884751 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884735 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="config-reloader" Jul 31 16:50:46.884807 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884753 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="config-reloader" Jul 31 16:50:46.884807 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884765 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="init-config-reloader" Jul 31 16:50:46.884807 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884775 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="init-config-reloader" Jul 31 16:50:46.884807 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884769 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22"} err="failed to get container status \"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22\": rpc error: code = NotFound desc = could not find container \"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22\": container with ID starting with ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22 not found: ID does not exist" Jul 31 16:50:46.884807 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884788 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="kube-rbac-proxy-thanos" Jul 31 16:50:46.884807 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884796 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="kube-rbac-proxy-thanos" Jul 31 16:50:46.884807 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884806 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="prometheus" Jul 31 16:50:46.884807 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884812 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="prometheus" Jul 31 16:50:46.885242 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884819 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="thanos-sidecar" Jul 31 16:50:46.885242 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884824 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="thanos-sidecar" Jul 31 16:50:46.885242 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884835 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="kube-rbac-proxy-web" Jul 31 16:50:46.885242 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884840 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="kube-rbac-proxy-web" Jul 31 16:50:46.885242 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884848 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="kube-rbac-proxy" Jul 31 16:50:46.885242 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884854 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="kube-rbac-proxy" Jul 31 16:50:46.885242 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884794 2586 scope.go:117] "RemoveContainer" containerID="0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af" Jul 31 16:50:46.885242 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884926 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="kube-rbac-proxy" Jul 31 16:50:46.885242 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884937 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="thanos-sidecar" Jul 31 16:50:46.885242 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884948 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="prometheus" Jul 31 16:50:46.885242 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884956 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="kube-rbac-proxy-web" Jul 31 16:50:46.885242 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884965 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="config-reloader" Jul 31 16:50:46.885242 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.884973 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" containerName="kube-rbac-proxy-thanos" Jul 31 16:50:46.885242 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.885138 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af"} err="failed to get container status \"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af\": rpc error: code = NotFound desc = could not find container \"0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af\": container with ID starting with 0804c68fb628e3d28512eb1d019a450ccf3a1d8fbbfa1b2f43fcd7df794c89af not found: ID does not exist" Jul 31 16:50:46.885242 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.885154 2586 scope.go:117] "RemoveContainer" containerID="e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923" Jul 31 16:50:46.885857 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.885352 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923"} err="failed to get container status \"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923\": rpc error: code = NotFound desc = could not find container \"e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923\": container with ID starting with e3dda766be61537cf20e37dfcee1a5bf0cd8ae3904266b07cf5904578a444923 not found: ID does not exist" Jul 31 16:50:46.885857 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.885366 2586 scope.go:117] "RemoveContainer" containerID="5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae" Jul 31 16:50:46.885857 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.885583 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae"} err="failed to get container status \"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae\": rpc error: code = NotFound desc = could not find container \"5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae\": container with ID starting with 5da41a90194d4b49c1581e8f2f4d29cd8fe61713e0d43695cdf4ce3dbe1e56ae not found: ID does not exist" Jul 31 16:50:46.885857 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.885597 2586 scope.go:117] "RemoveContainer" containerID="9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475" Jul 31 16:50:46.885857 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.885812 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475"} err="failed to get container status \"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475\": rpc error: code = NotFound desc = could not find container \"9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475\": container with ID starting with 9126604deccacc82f82446e71c5c0bc09ba63f48ac476adf002284f19cc54475 not found: ID does not exist" Jul 31 16:50:46.885857 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.885838 2586 scope.go:117] "RemoveContainer" containerID="639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7" Jul 31 16:50:46.886104 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.886083 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7"} err="failed to get container status \"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7\": rpc error: code = NotFound desc = could not find container \"639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7\": container with ID starting with 639e486f2147ee3bdb8666e46406a19ea3d7ac9cedc78fa0b6b160c18f4032d7 not found: ID does not exist" Jul 31 16:50:46.886159 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.886106 2586 scope.go:117] "RemoveContainer" containerID="86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb" Jul 31 16:50:46.886324 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.886297 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb"} err="failed to get container status \"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb\": rpc error: code = NotFound desc = could not find container \"86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb\": container with ID starting with 86e609c41fb5101efbc873355eefca44384238638e8fad31b8e77d10fb655bdb not found: ID does not exist" Jul 31 16:50:46.886324 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.886325 2586 scope.go:117] "RemoveContainer" containerID="ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22" Jul 31 16:50:46.886616 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.886590 2586 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22"} err="failed to get container status \"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22\": rpc error: code = NotFound desc = could not find container \"ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22\": container with ID starting with ff1aaea26a33cf6f21ef8cdce5ca667f2dab5b343f06696e7b3605604f774a22 not found: ID does not exist" Jul 31 16:50:46.888614 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.888597 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.891289 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.891256 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 31 16:50:46.891677 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.891655 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 31 16:50:46.892014 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.891994 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 31 16:50:46.892214 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.892196 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 31 16:50:46.892631 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.892538 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 31 16:50:46.892934 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.892816 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 31 16:50:46.892934 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.892828 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tl2tj\"" Jul 31 16:50:46.892934 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.892854 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 31 16:50:46.892934 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.892828 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 31 16:50:46.893321 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.892995 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 31 16:50:46.893321 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.893028 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 31 16:50:46.893321 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.893029 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 31 16:50:46.893481 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.893380 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-df94rg3q3hfpm\"" Jul 31 16:50:46.893806 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.893790 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 31 16:50:46.896604 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.896584 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 31 16:50:46.898028 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.898007 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 31 16:50:46.906294 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.906271 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 16:50:46.950425 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.950393 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.950607 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.950438 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.950607 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.950487 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf33472d-bf67-4341-9c84-2bc2acaf3f79-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.950607 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.950562 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.950607 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.950603 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.950779 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.950629 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.950779 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.950691 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.950779 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.950717 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bf33472d-bf67-4341-9c84-2bc2acaf3f79-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.950940 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.950838 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.950940 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.950863 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfmsb\" (UniqueName: \"kubernetes.io/projected/bf33472d-bf67-4341-9c84-2bc2acaf3f79-kube-api-access-qfmsb\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.950940 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.950906 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.950940 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.950927 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf33472d-bf67-4341-9c84-2bc2acaf3f79-config-out\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.951134 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.950998 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.951134 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.951042 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.951134 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.951086 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-web-config\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.951134 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.951117 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.951311 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.951164 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.951311 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.951215 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-config\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.951379 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.951314 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:46.951379 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:46.951337 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.051888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.051833 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.051888 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.051881 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.052192 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.051911 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.052192 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.051937 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bf33472d-bf67-4341-9c84-2bc2acaf3f79-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.052192 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.051956 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.052538 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.052506 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfmsb\" (UniqueName: \"kubernetes.io/projected/bf33472d-bf67-4341-9c84-2bc2acaf3f79-kube-api-access-qfmsb\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.052622 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.052570 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.052681 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.052623 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf33472d-bf67-4341-9c84-2bc2acaf3f79-config-out\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.052681 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.052667 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.052785 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.052702 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.052785 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.052730 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-web-config\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.052785 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.052760 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.052924 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.052791 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.052924 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.052825 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-config\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.052924 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.052885 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.052924 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.052908 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.053139 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.052912 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.053139 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.052979 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.053139 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.053013 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.053139 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.053048 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf33472d-bf67-4341-9c84-2bc2acaf3f79-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.053139 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.053098 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.053384 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.053335 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.053435 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.053378 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.053516 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.053467 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bf33472d-bf67-4341-9c84-2bc2acaf3f79-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.053670 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.053613 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.054615 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.054302 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.055118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.054963 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.055118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.054972 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.055118 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.055069 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.057492 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.057423 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.057586 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.057504 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-web-config\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.058528 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.058483 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-config\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.058528 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.058510 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf33472d-bf67-4341-9c84-2bc2acaf3f79-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.058664 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.058602 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bf33472d-bf67-4341-9c84-2bc2acaf3f79-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.058759 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.058734 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.059131 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.059106 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.059379 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.059357 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.060612 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.060592 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bf33472d-bf67-4341-9c84-2bc2acaf3f79-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.060612 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.060618 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf33472d-bf67-4341-9c84-2bc2acaf3f79-config-out\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.062762 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.062741 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfmsb\" (UniqueName: \"kubernetes.io/projected/bf33472d-bf67-4341-9c84-2bc2acaf3f79-kube-api-access-qfmsb\") pod \"prometheus-k8s-0\" (UID: \"bf33472d-bf67-4341-9c84-2bc2acaf3f79\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.201020 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.200920 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:50:47.382951 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.382926 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 31 16:50:47.384227 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:50:47.384200 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf33472d_bf67_4341_9c84_2bc2acaf3f79.slice/crio-1081f51697a56ce3b51209bc52bebf354f64c1030047e95cfafb1f205b90ba7d WatchSource:0}: Error finding container 1081f51697a56ce3b51209bc52bebf354f64c1030047e95cfafb1f205b90ba7d: Status 404 returned error can't find the container with id 1081f51697a56ce3b51209bc52bebf354f64c1030047e95cfafb1f205b90ba7d Jul 31 16:50:47.821002 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.820967 2586 generic.go:356] "Generic (PLEG): container finished" podID="bf33472d-bf67-4341-9c84-2bc2acaf3f79" containerID="6884a607825ee53e4964c7633e1999e3491ee5b251b37a95ab25caee70f5ae5d" exitCode=0 Jul 31 16:50:47.821535 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.821061 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf33472d-bf67-4341-9c84-2bc2acaf3f79","Type":"ContainerDied","Data":"6884a607825ee53e4964c7633e1999e3491ee5b251b37a95ab25caee70f5ae5d"} Jul 31 16:50:47.821535 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:47.821148 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf33472d-bf67-4341-9c84-2bc2acaf3f79","Type":"ContainerStarted","Data":"1081f51697a56ce3b51209bc52bebf354f64c1030047e95cfafb1f205b90ba7d"} Jul 31 16:50:48.722572 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:48.722538 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3" path="/var/lib/kubelet/pods/86baf0e1-cfc3-4c77-a37e-7fe55ba5a4d3/volumes" Jul 31 16:50:48.828179 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:48.828135 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" event={"ID":"431a14eb-d218-409d-9a07-2cde22ccda13","Type":"ContainerStarted","Data":"c68a45ada93aa3f4377194b3a444c7674bff13c35dded37ea67aaf5e6d878a84"} Jul 31 16:50:48.828591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:48.828197 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" event={"ID":"431a14eb-d218-409d-9a07-2cde22ccda13","Type":"ContainerStarted","Data":"03c271138823aa301882e1ac2fbf7a2145b7d14a48e9312ae569293c424db66f"} Jul 31 16:50:48.828591 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:48.828222 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" event={"ID":"431a14eb-d218-409d-9a07-2cde22ccda13","Type":"ContainerStarted","Data":"34968aac3b4c9fa2bd1d1faf700db087187f8538e9f1d913925a053ec88e013c"} Jul 31 16:50:48.831204 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:48.831179 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf33472d-bf67-4341-9c84-2bc2acaf3f79","Type":"ContainerStarted","Data":"7e9aeb391e52c813789fff8dee0e4e1b62327f63411338fe50f3b44df0d12727"} Jul 31 16:50:48.831347 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:48.831244 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf33472d-bf67-4341-9c84-2bc2acaf3f79","Type":"ContainerStarted","Data":"f7b9d5de6809778b8743f126e9ff40a1fb3934f7b6b67cc6761936e8c4fece74"} Jul 31 16:50:48.831347 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:48.831299 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf33472d-bf67-4341-9c84-2bc2acaf3f79","Type":"ContainerStarted","Data":"46a6ff4828d935192e381251130d96a0c01bebea30bafe2ef9d8259422322a1b"} Jul 31 16:50:48.831347 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:48.831339 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf33472d-bf67-4341-9c84-2bc2acaf3f79","Type":"ContainerStarted","Data":"a9776f529a7f53c1b661063b7b880cc6e6278c7340ff24f320c2953cfba59566"} Jul 31 16:50:48.831522 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:48.831384 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf33472d-bf67-4341-9c84-2bc2acaf3f79","Type":"ContainerStarted","Data":"f7482d0d02d77d8258dcc31c9676b921340af55aaa04f1ebe8d174f2d5060024"} Jul 31 16:50:48.831522 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:48.831424 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bf33472d-bf67-4341-9c84-2bc2acaf3f79","Type":"ContainerStarted","Data":"98f1d3a92b61771092846ba63895644a44b4e0bf0d74cddff55422a622f0aae6"} Jul 31 16:50:48.853315 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:48.853238 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-796656dbd5-dblwd" podStartSLOduration=1.5517304109999999 podStartE2EDuration="3.853223224s" totalImagesPullingTime="2.301492813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:50:48.851729568 +0000 UTC m=+228.622759874" watchObservedRunningTime="2026-07-31 16:50:48.853223224 +0000 UTC m=+228.624253531" Jul 31 16:50:48.880871 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:48.880825 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.860150216 podStartE2EDuration="2.880810929s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.660713ms" isStatefulPod=false podCreationTimestamp="2026-07-31 16:50:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:50:48.878548798 +0000 UTC m=+228.649579120" watchObservedRunningTime="2026-07-31 16:50:48.880810929 +0000 UTC m=+228.651841273" Jul 31 16:50:52.202067 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:50:52.202027 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:51:47.201648 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:51:47.201596 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:51:47.217872 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:51:47.217845 2586 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:51:48.089907 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:51:48.089877 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 31 16:52:00.664797 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:52:00.664771 2586 kubelet.go:1648] "Image garbage collection succeeded" Jul 31 16:54:27.609773 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:27.609674 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-n8mfc"] Jul 31 16:54:27.612902 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:27.612885 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-n8mfc" Jul 31 16:54:27.615299 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:27.615270 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 31 16:54:27.616204 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:27.616184 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 31 16:54:27.616319 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:27.616241 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-dhbvv\"" Jul 31 16:54:27.622771 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:27.622750 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-n8mfc"] Jul 31 16:54:27.741396 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:27.741360 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7079e695-2972-463d-a6ee-e5da166b6e69-tmp\") pod \"jobset-operator-5bc45f897-n8mfc\" (UID: \"7079e695-2972-463d-a6ee-e5da166b6e69\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-n8mfc" Jul 31 16:54:27.741592 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:27.741404 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw9l4\" (UniqueName: \"kubernetes.io/projected/7079e695-2972-463d-a6ee-e5da166b6e69-kube-api-access-dw9l4\") pod \"jobset-operator-5bc45f897-n8mfc\" (UID: \"7079e695-2972-463d-a6ee-e5da166b6e69\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-n8mfc" Jul 31 16:54:27.841921 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:27.841885 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7079e695-2972-463d-a6ee-e5da166b6e69-tmp\") pod \"jobset-operator-5bc45f897-n8mfc\" (UID: \"7079e695-2972-463d-a6ee-e5da166b6e69\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-n8mfc" Jul 31 16:54:27.842070 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:27.841942 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw9l4\" (UniqueName: \"kubernetes.io/projected/7079e695-2972-463d-a6ee-e5da166b6e69-kube-api-access-dw9l4\") pod \"jobset-operator-5bc45f897-n8mfc\" (UID: \"7079e695-2972-463d-a6ee-e5da166b6e69\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-n8mfc" Jul 31 16:54:27.842317 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:27.842298 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7079e695-2972-463d-a6ee-e5da166b6e69-tmp\") pod \"jobset-operator-5bc45f897-n8mfc\" (UID: \"7079e695-2972-463d-a6ee-e5da166b6e69\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-n8mfc" Jul 31 16:54:27.850833 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:27.850802 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw9l4\" (UniqueName: \"kubernetes.io/projected/7079e695-2972-463d-a6ee-e5da166b6e69-kube-api-access-dw9l4\") pod \"jobset-operator-5bc45f897-n8mfc\" (UID: \"7079e695-2972-463d-a6ee-e5da166b6e69\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-n8mfc" Jul 31 16:54:27.934236 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:27.934136 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-n8mfc" Jul 31 16:54:28.067536 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:28.067511 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-n8mfc"] Jul 31 16:54:28.070266 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:54:28.070237 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7079e695_2972_463d_a6ee_e5da166b6e69.slice/crio-0f1ec6af15745261b9f5a433895b8d93dcc72d198259e93d528568e13c0d4b93 WatchSource:0}: Error finding container 0f1ec6af15745261b9f5a433895b8d93dcc72d198259e93d528568e13c0d4b93: Status 404 returned error can't find the container with id 0f1ec6af15745261b9f5a433895b8d93dcc72d198259e93d528568e13c0d4b93 Jul 31 16:54:28.071668 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:28.071646 2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 16:54:28.726241 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:28.726172 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-n8mfc" event={"ID":"7079e695-2972-463d-a6ee-e5da166b6e69","Type":"ContainerStarted","Data":"0f1ec6af15745261b9f5a433895b8d93dcc72d198259e93d528568e13c0d4b93"} Jul 31 16:54:30.735945 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:30.735902 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-n8mfc" event={"ID":"7079e695-2972-463d-a6ee-e5da166b6e69","Type":"ContainerStarted","Data":"25d3aa252045e15dfbf8a813037f4bab389d8ec821d0dc026e09281106cd27e2"} Jul 31 16:54:30.753994 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:30.753950 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-n8mfc" podStartSLOduration=1.308767496 podStartE2EDuration="3.753936276s" totalImagesPullingTime="2.44516878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:54:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:54:30.752889891 +0000 UTC m=+450.523920200" watchObservedRunningTime="2026-07-31 16:54:30.753936276 +0000 UTC m=+450.524966583" Jul 31 16:54:58.404722 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.404686 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv"] Jul 31 16:54:58.407994 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.407977 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv" Jul 31 16:54:58.410768 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.410742 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 31 16:54:58.410926 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.410742 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 31 16:54:58.410926 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.410789 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 31 16:54:58.411898 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.411881 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-4lrl4\"" Jul 31 16:54:58.411898 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.411890 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 31 16:54:58.419988 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.419969 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv"] Jul 31 16:54:58.498983 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.498951 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5-cert\") pod \"kubeflow-trainer-controller-manager-99b9897b5-9nhmv\" (UID: \"fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5\") " pod="opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv" Jul 31 16:54:58.499241 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.498988 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-99b9897b5-9nhmv\" (UID: \"fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5\") " pod="opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv" Jul 31 16:54:58.499241 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.499038 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4gmq\" (UniqueName: \"kubernetes.io/projected/fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5-kube-api-access-s4gmq\") pod \"kubeflow-trainer-controller-manager-99b9897b5-9nhmv\" (UID: \"fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5\") " pod="opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv" Jul 31 16:54:58.599791 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.599755 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4gmq\" (UniqueName: \"kubernetes.io/projected/fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5-kube-api-access-s4gmq\") pod \"kubeflow-trainer-controller-manager-99b9897b5-9nhmv\" (UID: \"fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5\") " pod="opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv" Jul 31 16:54:58.599976 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.599848 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5-cert\") pod \"kubeflow-trainer-controller-manager-99b9897b5-9nhmv\" (UID: \"fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5\") " pod="opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv" Jul 31 16:54:58.599976 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.599877 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-99b9897b5-9nhmv\" (UID: \"fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5\") " pod="opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv" Jul 31 16:54:58.600516 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.600491 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-99b9897b5-9nhmv\" (UID: \"fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5\") " pod="opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv" Jul 31 16:54:58.602154 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.602131 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5-cert\") pod \"kubeflow-trainer-controller-manager-99b9897b5-9nhmv\" (UID: \"fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5\") " pod="opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv" Jul 31 16:54:58.608321 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.608294 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4gmq\" (UniqueName: \"kubernetes.io/projected/fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5-kube-api-access-s4gmq\") pod \"kubeflow-trainer-controller-manager-99b9897b5-9nhmv\" (UID: \"fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5\") " pod="opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv" Jul 31 16:54:58.717637 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.717555 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv" Jul 31 16:54:58.850086 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:58.850058 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv"] Jul 31 16:54:58.854189 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:54:58.854160 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc0ac1f2_4551_4f41_bba9_f9d65dbb24f5.slice/crio-707ff50528d09fd525211530ee1a7f8798537dbbc86e907ae62f0ec8bc39a995 WatchSource:0}: Error finding container 707ff50528d09fd525211530ee1a7f8798537dbbc86e907ae62f0ec8bc39a995: Status 404 returned error can't find the container with id 707ff50528d09fd525211530ee1a7f8798537dbbc86e907ae62f0ec8bc39a995 Jul 31 16:54:59.850097 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:54:59.850053 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv" event={"ID":"fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5","Type":"ContainerStarted","Data":"707ff50528d09fd525211530ee1a7f8798537dbbc86e907ae62f0ec8bc39a995"} Jul 31 16:55:01.860741 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:55:01.860707 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv" event={"ID":"fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5","Type":"ContainerStarted","Data":"dec0eec760ba1e3cfd9120ae42985b24772cf6b542bd41357e49b00b29f4b8be"} Jul 31 16:55:01.861192 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:55:01.860781 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv" Jul 31 16:55:01.877507 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:55:01.877433 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv" podStartSLOduration=1.448832938 podStartE2EDuration="3.877419177s" totalImagesPullingTime="2.428586239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 16:55:01.876256569 +0000 UTC m=+481.647286878" watchObservedRunningTime="2026-07-31 16:55:01.877419177 +0000 UTC m=+481.648449485" Jul 31 16:55:17.870074 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:55:17.870042 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-99b9897b5-9nhmv" Jul 31 16:56:00.693378 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:56:00.693299 2586 scope.go:117] "RemoveContainer" containerID="d0dd57f39bc6a9d77a7c20ab0f39182452e2b90704fba3c89612319c1e910027" Jul 31 16:56:00.700979 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:56:00.700958 2586 scope.go:117] "RemoveContainer" containerID="5351f76604d6e6d0ca36b15f0040743ba31c76c698f9869767638f1219b7d5dd" Jul 31 16:56:00.708251 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:56:00.708235 2586 scope.go:117] "RemoveContainer" containerID="12568320a3c59117ca9a5aa5be52400a3d97e10bcf45117dd4ce293210742351" Jul 31 16:56:00.715160 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:56:00.715141 2586 scope.go:117] "RemoveContainer" containerID="c672a33323998281382031a2a0ce6eb2b4bbbb62e7014f294a1f56d1066c8b48" Jul 31 16:56:00.722696 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:56:00.722676 2586 scope.go:117] "RemoveContainer" containerID="281a72f29a3807ceebe0d22f2a87814b666735eadfbeb8939f3ab544b95df08c" Jul 31 16:56:00.729223 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:56:00.729202 2586 scope.go:117] "RemoveContainer" containerID="6bb3551aa3799aecbc1059e0633abe76563247fdca607b4513101cd245cdb581" Jul 31 16:56:00.736028 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:56:00.736010 2586 scope.go:117] "RemoveContainer" containerID="12edd0b9599595eaf07c8d654d64bf3b56a4189f711737dcd200dec2e25a1404" Jul 31 16:59:27.734994 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:59:27.734915 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc"] Jul 31 16:59:27.737997 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:59:27.737979 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc" Jul 31 16:59:27.740540 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:59:27.740519 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-fkhm7\"/\"openshift-service-ca.crt\"" Jul 31 16:59:27.740653 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:59:27.740522 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-fkhm7\"/\"kube-root-ca.crt\"" Jul 31 16:59:27.740653 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:59:27.740577 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-fkhm7\"/\"default-dockercfg-c7l2w\"" Jul 31 16:59:27.748896 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:59:27.748867 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc"] Jul 31 16:59:27.839485 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:59:27.839428 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgd9c\" (UniqueName: \"kubernetes.io/projected/733221a6-5166-40d7-b7ab-fd800be6d7d0-kube-api-access-wgd9c\") pod \"progression-custom-config-node-0-0-ngmhc\" (UID: \"733221a6-5166-40d7-b7ab-fd800be6d7d0\") " pod="rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc" Jul 31 16:59:27.940349 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:59:27.940314 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgd9c\" (UniqueName: \"kubernetes.io/projected/733221a6-5166-40d7-b7ab-fd800be6d7d0-kube-api-access-wgd9c\") pod \"progression-custom-config-node-0-0-ngmhc\" (UID: \"733221a6-5166-40d7-b7ab-fd800be6d7d0\") " pod="rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc" Jul 31 16:59:27.949137 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:59:27.949110 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgd9c\" (UniqueName: \"kubernetes.io/projected/733221a6-5166-40d7-b7ab-fd800be6d7d0-kube-api-access-wgd9c\") pod \"progression-custom-config-node-0-0-ngmhc\" (UID: \"733221a6-5166-40d7-b7ab-fd800be6d7d0\") " pod="rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc" Jul 31 16:59:28.048466 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:59:28.048416 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc" Jul 31 16:59:28.186676 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:59:28.186576 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc"] Jul 31 16:59:28.189554 ip-10-0-140-127 kubenswrapper[2586]: W0731 16:59:28.189520 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733221a6_5166_40d7_b7ab_fd800be6d7d0.slice/crio-f0538d98a6bab8533a39249730f3bebf17ea6660b3fd5ecfaa3cf59ac9bb5142 WatchSource:0}: Error finding container f0538d98a6bab8533a39249730f3bebf17ea6660b3fd5ecfaa3cf59ac9bb5142: Status 404 returned error can't find the container with id f0538d98a6bab8533a39249730f3bebf17ea6660b3fd5ecfaa3cf59ac9bb5142 Jul 31 16:59:28.192024 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:59:28.192006 2586 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 31 16:59:28.941824 ip-10-0-140-127 kubenswrapper[2586]: I0731 16:59:28.941776 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc" event={"ID":"733221a6-5166-40d7-b7ab-fd800be6d7d0","Type":"ContainerStarted","Data":"f0538d98a6bab8533a39249730f3bebf17ea6660b3fd5ecfaa3cf59ac9bb5142"} Jul 31 17:01:08.434243 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:08.434201 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc" event={"ID":"733221a6-5166-40d7-b7ab-fd800be6d7d0","Type":"ContainerStarted","Data":"1cf0f76f83a750f801ce57eba4a548f0e481c795b11cfa6b42c241c656f4f3fc"} Jul 31 17:01:08.434745 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:08.434328 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc" Jul 31 17:01:08.463114 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:08.463052 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc" podStartSLOduration=1.8200420099999999 podStartE2EDuration="1m41.463031183s" totalImagesPullingTime="1m39.642989173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 16:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 17:01:08.461195922 +0000 UTC m=+848.232226235" watchObservedRunningTime="2026-07-31 17:01:08.463031183 +0000 UTC m=+848.234061495" Jul 31 17:01:09.436877 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:09.436826 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc" podUID="733221a6-5166-40d7-b7ab-fd800be6d7d0" containerName="node" probeResult="failure" output="Get \"http://10.132.0.26:28080/metrics\": dial tcp 10.132.0.26:28080: connect: connection refused" Jul 31 17:01:09.439256 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:09.439213 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc" podUID="733221a6-5166-40d7-b7ab-fd800be6d7d0" containerName="node" probeResult="failure" output="Get \"http://10.132.0.26:28080/metrics\": dial tcp 10.132.0.26:28080: connect: connection refused" Jul 31 17:01:10.441199 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:10.441168 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc" Jul 31 17:01:31.440041 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:31.439941 2586 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc" podUID="733221a6-5166-40d7-b7ab-fd800be6d7d0" containerName="node" probeResult="failure" output="Get \"http://10.132.0.26:28080/metrics\": dial tcp 10.132.0.26:28080: connect: connection refused" Jul 31 17:01:31.534761 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:31.534729 2586 generic.go:356] "Generic (PLEG): container finished" podID="733221a6-5166-40d7-b7ab-fd800be6d7d0" containerID="1cf0f76f83a750f801ce57eba4a548f0e481c795b11cfa6b42c241c656f4f3fc" exitCode=0 Jul 31 17:01:31.534941 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:31.534798 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc" event={"ID":"733221a6-5166-40d7-b7ab-fd800be6d7d0","Type":"ContainerDied","Data":"1cf0f76f83a750f801ce57eba4a548f0e481c795b11cfa6b42c241c656f4f3fc"} Jul 31 17:01:32.691430 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:32.691407 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc" Jul 31 17:01:32.870680 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:32.870604 2586 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgd9c\" (UniqueName: \"kubernetes.io/projected/733221a6-5166-40d7-b7ab-fd800be6d7d0-kube-api-access-wgd9c\") pod \"733221a6-5166-40d7-b7ab-fd800be6d7d0\" (UID: \"733221a6-5166-40d7-b7ab-fd800be6d7d0\") " Jul 31 17:01:32.872731 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:32.872708 2586 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/733221a6-5166-40d7-b7ab-fd800be6d7d0-kube-api-access-wgd9c" (OuterVolumeSpecName: "kube-api-access-wgd9c") pod "733221a6-5166-40d7-b7ab-fd800be6d7d0" (UID: "733221a6-5166-40d7-b7ab-fd800be6d7d0"). InnerVolumeSpecName "kube-api-access-wgd9c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 31 17:01:32.971960 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:32.971925 2586 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgd9c\" (UniqueName: \"kubernetes.io/projected/733221a6-5166-40d7-b7ab-fd800be6d7d0-kube-api-access-wgd9c\") on node \"ip-10-0-140-127.ec2.internal\" DevicePath \"\"" Jul 31 17:01:33.544851 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:33.544823 2586 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc" Jul 31 17:01:33.545028 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:33.544871 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc" event={"ID":"733221a6-5166-40d7-b7ab-fd800be6d7d0","Type":"ContainerDied","Data":"f0538d98a6bab8533a39249730f3bebf17ea6660b3fd5ecfaa3cf59ac9bb5142"} Jul 31 17:01:33.545028 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:33.544914 2586 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0538d98a6bab8533a39249730f3bebf17ea6660b3fd5ecfaa3cf59ac9bb5142" Jul 31 17:01:37.376082 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:37.376050 2586 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc"] Jul 31 17:01:37.379956 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:37.379929 2586 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-fkhm7/progression-custom-config-node-0-0-ngmhc"] Jul 31 17:01:38.723102 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:38.723066 2586 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="733221a6-5166-40d7-b7ab-fd800be6d7d0" path="/var/lib/kubelet/pods/733221a6-5166-40d7-b7ab-fd800be6d7d0/volumes" Jul 31 17:01:49.586207 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:49.586175 2586 ???:1] "http: TLS handshake error from 10.0.140.34:47754: EOF" Jul 31 17:01:49.600909 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:49.600876 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-99b9897b5-9nhmv_fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5/manager/0.log" Jul 31 17:01:50.089202 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:50.089176 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-99b9897b5-9nhmv_fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5/manager/0.log" Jul 31 17:01:50.554562 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:01:50.554529 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-99b9897b5-9nhmv_fc0ac1f2-4551-4f41-bba9-f9d65dbb24f5/manager/0.log" Jul 31 17:02:27.807373 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:27.807339 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j7xss/must-gather-4n4cf"] Jul 31 17:02:27.807856 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:27.807699 2586 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733221a6-5166-40d7-b7ab-fd800be6d7d0" containerName="node" Jul 31 17:02:27.807856 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:27.807714 2586 state_mem.go:107] "Deleted CPUSet assignment" podUID="733221a6-5166-40d7-b7ab-fd800be6d7d0" containerName="node" Jul 31 17:02:27.807856 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:27.807778 2586 memory_manager.go:368] "RemoveStaleState removing state" podUID="733221a6-5166-40d7-b7ab-fd800be6d7d0" containerName="node" Jul 31 17:02:27.809764 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:27.809748 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j7xss/must-gather-4n4cf" Jul 31 17:02:27.812606 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:27.812584 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j7xss\"/\"kube-root-ca.crt\"" Jul 31 17:02:27.812746 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:27.812665 2586 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j7xss\"/\"default-dockercfg-jrbmh\"" Jul 31 17:02:27.813523 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:27.813503 2586 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j7xss\"/\"openshift-service-ca.crt\"" Jul 31 17:02:27.817648 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:27.817626 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j7xss/must-gather-4n4cf"] Jul 31 17:02:27.853264 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:27.853232 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/74155d9c-23b0-4650-8ee4-c2699dc4c708-must-gather-output\") pod \"must-gather-4n4cf\" (UID: \"74155d9c-23b0-4650-8ee4-c2699dc4c708\") " pod="openshift-must-gather-j7xss/must-gather-4n4cf" Jul 31 17:02:27.853420 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:27.853304 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4jst\" (UniqueName: \"kubernetes.io/projected/74155d9c-23b0-4650-8ee4-c2699dc4c708-kube-api-access-z4jst\") pod \"must-gather-4n4cf\" (UID: \"74155d9c-23b0-4650-8ee4-c2699dc4c708\") " pod="openshift-must-gather-j7xss/must-gather-4n4cf" Jul 31 17:02:27.954343 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:27.954308 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4jst\" (UniqueName: \"kubernetes.io/projected/74155d9c-23b0-4650-8ee4-c2699dc4c708-kube-api-access-z4jst\") pod \"must-gather-4n4cf\" (UID: \"74155d9c-23b0-4650-8ee4-c2699dc4c708\") " pod="openshift-must-gather-j7xss/must-gather-4n4cf" Jul 31 17:02:27.954554 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:27.954367 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/74155d9c-23b0-4650-8ee4-c2699dc4c708-must-gather-output\") pod \"must-gather-4n4cf\" (UID: \"74155d9c-23b0-4650-8ee4-c2699dc4c708\") " pod="openshift-must-gather-j7xss/must-gather-4n4cf" Jul 31 17:02:27.954670 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:27.954649 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/74155d9c-23b0-4650-8ee4-c2699dc4c708-must-gather-output\") pod \"must-gather-4n4cf\" (UID: \"74155d9c-23b0-4650-8ee4-c2699dc4c708\") " pod="openshift-must-gather-j7xss/must-gather-4n4cf" Jul 31 17:02:27.963018 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:27.962995 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4jst\" (UniqueName: \"kubernetes.io/projected/74155d9c-23b0-4650-8ee4-c2699dc4c708-kube-api-access-z4jst\") pod \"must-gather-4n4cf\" (UID: \"74155d9c-23b0-4650-8ee4-c2699dc4c708\") " pod="openshift-must-gather-j7xss/must-gather-4n4cf" Jul 31 17:02:28.119301 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:28.119200 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j7xss/must-gather-4n4cf" Jul 31 17:02:28.247069 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:28.246931 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j7xss/must-gather-4n4cf"] Jul 31 17:02:28.249804 ip-10-0-140-127 kubenswrapper[2586]: W0731 17:02:28.249780 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74155d9c_23b0_4650_8ee4_c2699dc4c708.slice/crio-07df0e53beb3839ab92aacb104b671f71b23284de9c83abe614bf0b146b491af WatchSource:0}: Error finding container 07df0e53beb3839ab92aacb104b671f71b23284de9c83abe614bf0b146b491af: Status 404 returned error can't find the container with id 07df0e53beb3839ab92aacb104b671f71b23284de9c83abe614bf0b146b491af Jul 31 17:02:28.786880 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:28.786839 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j7xss/must-gather-4n4cf" event={"ID":"74155d9c-23b0-4650-8ee4-c2699dc4c708","Type":"ContainerStarted","Data":"07df0e53beb3839ab92aacb104b671f71b23284de9c83abe614bf0b146b491af"} Jul 31 17:02:29.795348 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:29.795311 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j7xss/must-gather-4n4cf" event={"ID":"74155d9c-23b0-4650-8ee4-c2699dc4c708","Type":"ContainerStarted","Data":"ce420ed17cfed4cf021f583e436525c948d875202fec770ef64940b7287e9855"} Jul 31 17:02:29.795348 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:29.795356 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j7xss/must-gather-4n4cf" event={"ID":"74155d9c-23b0-4650-8ee4-c2699dc4c708","Type":"ContainerStarted","Data":"a17cee166648081227ba3c11d80364bfb2706994939491d0a36afdac2e33e12e"} Jul 31 17:02:29.813055 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:29.812995 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j7xss/must-gather-4n4cf" podStartSLOduration=1.611912054 podStartE2EDuration="2.812972669s" totalImagesPullingTime="1.201060615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-31 17:02:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 17:02:29.811532818 +0000 UTC m=+929.582563127" watchObservedRunningTime="2026-07-31 17:02:29.812972669 +0000 UTC m=+929.584002980" Jul 31 17:02:30.846238 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:30.846167 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s2csx_7528c182-537a-43db-b0bd-5633029d814c/global-pull-secret-syncer/0.log" Jul 31 17:02:30.965884 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:30.965852 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hc82h_0fbfbd18-4216-4c43-8309-b97da0fe3ac2/konnectivity-agent/0.log" Jul 31 17:02:31.035196 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:31.035166 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-127.ec2.internal_0e837526304cd459e1a47dbb46a371da/haproxy/0.log" Jul 31 17:02:34.271015 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:34.270979 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_25212d4f-a10b-4ef5-894d-a782a6fab10c/alertmanager/0.log" Jul 31 17:02:34.318936 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:34.318870 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_25212d4f-a10b-4ef5-894d-a782a6fab10c/config-reloader/0.log" Jul 31 17:02:34.356312 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:34.356275 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_25212d4f-a10b-4ef5-894d-a782a6fab10c/kube-rbac-proxy-web/0.log" Jul 31 17:02:34.415211 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:34.415174 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_25212d4f-a10b-4ef5-894d-a782a6fab10c/kube-rbac-proxy/0.log" Jul 31 17:02:34.445273 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:34.445202 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_25212d4f-a10b-4ef5-894d-a782a6fab10c/kube-rbac-proxy-metric/0.log" Jul 31 17:02:34.473081 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:34.473043 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_25212d4f-a10b-4ef5-894d-a782a6fab10c/prom-label-proxy/0.log" Jul 31 17:02:34.523821 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:34.523741 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_25212d4f-a10b-4ef5-894d-a782a6fab10c/init-config-reloader/0.log" Jul 31 17:02:34.844184 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:34.844098 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6cc4986db8-ggklp_dd7fe337-da0b-4e48-8773-091cbaf32cc5/metrics-server/0.log" Jul 31 17:02:34.942465 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:34.942414 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5bdhc_76d2fdb8-6ade-44a2-933b-6a882947d6cc/node-exporter/0.log" Jul 31 17:02:34.985415 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:34.985378 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5bdhc_76d2fdb8-6ade-44a2-933b-6a882947d6cc/kube-rbac-proxy/0.log" Jul 31 17:02:35.027623 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:35.027590 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5bdhc_76d2fdb8-6ade-44a2-933b-6a882947d6cc/init-textfile/0.log" Jul 31 17:02:35.501247 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:35.501219 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf33472d-bf67-4341-9c84-2bc2acaf3f79/prometheus/0.log" Jul 31 17:02:35.542949 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:35.542909 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf33472d-bf67-4341-9c84-2bc2acaf3f79/config-reloader/0.log" Jul 31 17:02:35.609860 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:35.609831 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf33472d-bf67-4341-9c84-2bc2acaf3f79/thanos-sidecar/0.log" Jul 31 17:02:35.654581 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:35.654551 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf33472d-bf67-4341-9c84-2bc2acaf3f79/kube-rbac-proxy-web/0.log" Jul 31 17:02:35.701127 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:35.701072 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf33472d-bf67-4341-9c84-2bc2acaf3f79/kube-rbac-proxy/0.log" Jul 31 17:02:35.740616 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:35.740532 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf33472d-bf67-4341-9c84-2bc2acaf3f79/kube-rbac-proxy-thanos/0.log" Jul 31 17:02:35.787604 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:35.787575 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_bf33472d-bf67-4341-9c84-2bc2acaf3f79/init-config-reloader/0.log" Jul 31 17:02:35.922221 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:35.922195 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-g69ls_a4e97548-4437-43a2-a605-54570327a537/prometheus-operator-admission-webhook/0.log" Jul 31 17:02:35.970597 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:35.970566 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-796656dbd5-dblwd_431a14eb-d218-409d-9a07-2cde22ccda13/telemeter-client/0.log" Jul 31 17:02:35.995685 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:35.995602 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-796656dbd5-dblwd_431a14eb-d218-409d-9a07-2cde22ccda13/reload/0.log" Jul 31 17:02:36.020843 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:36.020817 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-796656dbd5-dblwd_431a14eb-d218-409d-9a07-2cde22ccda13/kube-rbac-proxy/0.log" Jul 31 17:02:37.501677 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:37.501644 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-p6vw6_41f7e379-4acf-4b2c-a4c8-a1974d5f0f10/networking-console-plugin/0.log" Jul 31 17:02:38.417811 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.417775 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-99v98_91150b92-736c-4657-9a02-d09f07c58e24/download-server/0.log" Jul 31 17:02:38.482677 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.482629 2586 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6"] Jul 31 17:02:38.487249 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.487222 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:38.503781 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.503746 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6"] Jul 31 17:02:38.560463 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.560409 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8cdc34bc-73a5-418e-9fcc-5793ed0904e4-proc\") pod \"perf-node-gather-daemonset-t59x6\" (UID: \"8cdc34bc-73a5-418e-9fcc-5793ed0904e4\") " pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:38.560642 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.560473 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8cdc34bc-73a5-418e-9fcc-5793ed0904e4-podres\") pod \"perf-node-gather-daemonset-t59x6\" (UID: \"8cdc34bc-73a5-418e-9fcc-5793ed0904e4\") " pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:38.560642 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.560561 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t55mx\" (UniqueName: \"kubernetes.io/projected/8cdc34bc-73a5-418e-9fcc-5793ed0904e4-kube-api-access-t55mx\") pod \"perf-node-gather-daemonset-t59x6\" (UID: \"8cdc34bc-73a5-418e-9fcc-5793ed0904e4\") " pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:38.560734 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.560646 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cdc34bc-73a5-418e-9fcc-5793ed0904e4-lib-modules\") pod \"perf-node-gather-daemonset-t59x6\" (UID: \"8cdc34bc-73a5-418e-9fcc-5793ed0904e4\") " pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:38.560734 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.560674 2586 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cdc34bc-73a5-418e-9fcc-5793ed0904e4-sys\") pod \"perf-node-gather-daemonset-t59x6\" (UID: \"8cdc34bc-73a5-418e-9fcc-5793ed0904e4\") " pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:38.661753 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.661710 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8cdc34bc-73a5-418e-9fcc-5793ed0904e4-proc\") pod \"perf-node-gather-daemonset-t59x6\" (UID: \"8cdc34bc-73a5-418e-9fcc-5793ed0904e4\") " pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:38.661753 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.661759 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8cdc34bc-73a5-418e-9fcc-5793ed0904e4-podres\") pod \"perf-node-gather-daemonset-t59x6\" (UID: \"8cdc34bc-73a5-418e-9fcc-5793ed0904e4\") " pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:38.661997 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.661856 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8cdc34bc-73a5-418e-9fcc-5793ed0904e4-proc\") pod \"perf-node-gather-daemonset-t59x6\" (UID: \"8cdc34bc-73a5-418e-9fcc-5793ed0904e4\") " pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:38.661997 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.661918 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t55mx\" (UniqueName: \"kubernetes.io/projected/8cdc34bc-73a5-418e-9fcc-5793ed0904e4-kube-api-access-t55mx\") pod \"perf-node-gather-daemonset-t59x6\" (UID: \"8cdc34bc-73a5-418e-9fcc-5793ed0904e4\") " pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:38.661997 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.661961 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8cdc34bc-73a5-418e-9fcc-5793ed0904e4-podres\") pod \"perf-node-gather-daemonset-t59x6\" (UID: \"8cdc34bc-73a5-418e-9fcc-5793ed0904e4\") " pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:38.661997 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.661978 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cdc34bc-73a5-418e-9fcc-5793ed0904e4-lib-modules\") pod \"perf-node-gather-daemonset-t59x6\" (UID: \"8cdc34bc-73a5-418e-9fcc-5793ed0904e4\") " pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:38.662220 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.662004 2586 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cdc34bc-73a5-418e-9fcc-5793ed0904e4-sys\") pod \"perf-node-gather-daemonset-t59x6\" (UID: \"8cdc34bc-73a5-418e-9fcc-5793ed0904e4\") " pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:38.662220 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.662129 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8cdc34bc-73a5-418e-9fcc-5793ed0904e4-lib-modules\") pod \"perf-node-gather-daemonset-t59x6\" (UID: \"8cdc34bc-73a5-418e-9fcc-5793ed0904e4\") " pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:38.662220 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.662171 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8cdc34bc-73a5-418e-9fcc-5793ed0904e4-sys\") pod \"perf-node-gather-daemonset-t59x6\" (UID: \"8cdc34bc-73a5-418e-9fcc-5793ed0904e4\") " pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:38.674198 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.674125 2586 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t55mx\" (UniqueName: \"kubernetes.io/projected/8cdc34bc-73a5-418e-9fcc-5793ed0904e4-kube-api-access-t55mx\") pod \"perf-node-gather-daemonset-t59x6\" (UID: \"8cdc34bc-73a5-418e-9fcc-5793ed0904e4\") " pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:38.812431 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.812387 2586 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:38.978394 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.978373 2586 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6"] Jul 31 17:02:38.978920 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:38.978899 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-f8zs6_1b024a5e-5d58-4ee0-bdd3-8bc7c7eccd34/volume-data-source-validator/0.log" Jul 31 17:02:38.981274 ip-10-0-140-127 kubenswrapper[2586]: W0731 17:02:38.981246 2586 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8cdc34bc_73a5_418e_9fcc_5793ed0904e4.slice/crio-a63bd865286101650e23020a223a60ac0b8a5f48095f1c35707e465609c99f59 WatchSource:0}: Error finding container a63bd865286101650e23020a223a60ac0b8a5f48095f1c35707e465609c99f59: Status 404 returned error can't find the container with id a63bd865286101650e23020a223a60ac0b8a5f48095f1c35707e465609c99f59 Jul 31 17:02:39.798377 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:39.798345 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fn9kg_4584e1cc-a4cd-4344-a274-416715cdc3e3/dns/0.log" Jul 31 17:02:39.819901 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:39.819879 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fn9kg_4584e1cc-a4cd-4344-a274-416715cdc3e3/kube-rbac-proxy/0.log" Jul 31 17:02:39.855818 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:39.855789 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" event={"ID":"8cdc34bc-73a5-418e-9fcc-5793ed0904e4","Type":"ContainerStarted","Data":"f44efba47f105116ebd1828944a0f26366c36d4bc0349bd0e84e01326dc9ab9e"} Jul 31 17:02:39.855949 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:39.855865 2586 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" event={"ID":"8cdc34bc-73a5-418e-9fcc-5793ed0904e4","Type":"ContainerStarted","Data":"a63bd865286101650e23020a223a60ac0b8a5f48095f1c35707e465609c99f59"} Jul 31 17:02:39.855949 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:39.855904 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:39.871352 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:39.871308 2586 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" podStartSLOduration=1.871284789 podStartE2EDuration="1.871284789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-31 17:02:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-31 17:02:39.870476936 +0000 UTC m=+939.641507241" watchObservedRunningTime="2026-07-31 17:02:39.871284789 +0000 UTC m=+939.642315097" Jul 31 17:02:39.937118 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:39.937094 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v6vm6_be2ba90e-7372-4e7f-bed4-ad0616ea12fd/dns-node-resolver/0.log" Jul 31 17:02:40.432138 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:40.432114 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ngdrm_b8937e2d-a751-457b-946d-3cb74eb3e2a2/node-ca/0.log" Jul 31 17:02:41.444554 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:41.444524 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lndfz_2c75fced-d017-49f8-939c-1a7922f8f194/serve-healthcheck-canary/0.log" Jul 31 17:02:41.880750 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:41.880725 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ffstb_dbe6f776-86dc-4704-a1fe-e655dcf25bad/kube-rbac-proxy/0.log" Jul 31 17:02:41.903308 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:41.903280 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ffstb_dbe6f776-86dc-4704-a1fe-e655dcf25bad/exporter/0.log" Jul 31 17:02:41.926854 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:41.926829 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ffstb_dbe6f776-86dc-4704-a1fe-e655dcf25bad/extractor/0.log" Jul 31 17:02:43.618172 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:43.618143 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-n8mfc_7079e695-2972-463d-a6ee-e5da166b6e69/jobset-operator/0.log" Jul 31 17:02:45.873405 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:45.873379 2586 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j7xss/perf-node-gather-daemonset-t59x6" Jul 31 17:02:46.886224 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:46.886195 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-kbssd_b480b79e-d002-46cb-9c96-4093dcc862ee/migrator/0.log" Jul 31 17:02:46.909500 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:46.909474 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-kbssd_b480b79e-d002-46cb-9c96-4093dcc862ee/graceful-termination/0.log" Jul 31 17:02:48.479472 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:48.479423 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bd2mc_756d5c76-69ba-4b10-ae30-50b0ca29aa13/kube-multus-additional-cni-plugins/0.log" Jul 31 17:02:48.502557 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:48.502523 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bd2mc_756d5c76-69ba-4b10-ae30-50b0ca29aa13/egress-router-binary-copy/0.log" Jul 31 17:02:48.525120 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:48.525093 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bd2mc_756d5c76-69ba-4b10-ae30-50b0ca29aa13/cni-plugins/0.log" Jul 31 17:02:48.547652 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:48.547625 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bd2mc_756d5c76-69ba-4b10-ae30-50b0ca29aa13/bond-cni-plugin/0.log" Jul 31 17:02:48.570990 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:48.570968 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bd2mc_756d5c76-69ba-4b10-ae30-50b0ca29aa13/routeoverride-cni/0.log" Jul 31 17:02:48.594526 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:48.594390 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bd2mc_756d5c76-69ba-4b10-ae30-50b0ca29aa13/whereabouts-cni-bincopy/0.log" Jul 31 17:02:48.617785 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:48.617761 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bd2mc_756d5c76-69ba-4b10-ae30-50b0ca29aa13/whereabouts-cni/0.log" Jul 31 17:02:48.975636 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:48.975541 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-p886w_b4f6ad55-a8ba-43fc-b3f2-aedde1e3392c/kube-multus/0.log" Jul 31 17:02:49.000615 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:49.000586 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fmdcm_74210898-48a8-42d3-a8f1-25708d2719cb/network-metrics-daemon/0.log" Jul 31 17:02:49.026161 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:49.026126 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fmdcm_74210898-48a8-42d3-a8f1-25708d2719cb/kube-rbac-proxy/0.log" Jul 31 17:02:50.306421 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:50.306346 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn5jp_edb94d9c-3df8-4c0c-bba9-92f25716db88/ovn-controller/0.log" Jul 31 17:02:50.327898 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:50.327871 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn5jp_edb94d9c-3df8-4c0c-bba9-92f25716db88/ovn-acl-logging/0.log" Jul 31 17:02:50.354424 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:50.354401 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn5jp_edb94d9c-3df8-4c0c-bba9-92f25716db88/kube-rbac-proxy-node/0.log" Jul 31 17:02:50.376730 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:50.376707 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn5jp_edb94d9c-3df8-4c0c-bba9-92f25716db88/kube-rbac-proxy-ovn-metrics/0.log" Jul 31 17:02:50.399500 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:50.399469 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn5jp_edb94d9c-3df8-4c0c-bba9-92f25716db88/northd/0.log" Jul 31 17:02:50.426760 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:50.426740 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn5jp_edb94d9c-3df8-4c0c-bba9-92f25716db88/nbdb/0.log" Jul 31 17:02:50.450762 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:50.450737 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn5jp_edb94d9c-3df8-4c0c-bba9-92f25716db88/sbdb/0.log" Jul 31 17:02:50.491911 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:50.491884 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fn5jp_edb94d9c-3df8-4c0c-bba9-92f25716db88/ovnkube-controller/0.log" Jul 31 17:02:51.590741 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:51.590710 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-65bdbbff45-pnlnq_023177fe-233f-4e8e-b1eb-906b0c21a7af/check-endpoints/0.log" Jul 31 17:02:51.641573 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:51.641548 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-rdsbm_c4753a62-82e4-4683-a90d-46ead858670b/network-check-target-container/0.log" Jul 31 17:02:52.580963 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:52.580932 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-q824w_03511f12-e0b8-4d9d-8470-032ef0530e8a/iptables-alerter/0.log" Jul 31 17:02:53.278016 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:53.277984 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-sfjqm_90971cfa-48b0-45cd-851f-76c4460175ea/tuned/0.log" Jul 31 17:02:54.980484 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:54.980401 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-559cbf5745-hgcf4_4a0fee27-1fbf-40f9-8c1a-0cade39d28f3/cluster-samples-operator/0.log" Jul 31 17:02:54.998629 ip-10-0-140-127 kubenswrapper[2586]: I0731 17:02:54.998598 2586 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-559cbf5745-hgcf4_4a0fee27-1fbf-40f9-8c1a-0cade39d28f3/cluster-samples-operator-watch/0.log"